00010000:00010000:1.0F:1769754698.086695:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0F:1769754698.157580:0:53834:0:(osp_sync.c:1806:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1769754698.157641:0:53834:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738449 is committed 00000004:00080000:0.0:1769754698.157672:0:53834:0:(osp_sync.c:1806:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1769754698.157684:0:53834:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94af2949ff00 refcount 2 committed 0 result 0 batchid 30064771698 00000020:00080000:0.0:1769754698.157689:0:53834:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff94af3dc12800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94af2949fcc0 00000020:00080000:0.0:1769754698.157693:0:53834:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff94af3dc12c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ae10ebe000 00010000:00010000:2.0F:1769754698.157701:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157719:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157727:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157734:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a6400 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754698.157740:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157751:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157772:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff94af2d215100) 00010000:00010000:2.0:1769754698.157775:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769754698.157782:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157788:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6400/0x98cc23d8b8497685 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157817:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157824:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157830:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157835:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a6600 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754698.157844:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157851:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157860:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff94af2d215c00) 00010000:00010000:2.0:1769754698.157863:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769754698.157866:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 2/0,0 mode: --/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157872:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6600/0x98cc23d8b849768c lrc: 0/0,0 mode: --/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157890:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157896:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157902:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157906:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae1362f000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754698.157909:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157914:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157921:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff94af2d215c00) 00000020:00080000:0.0:1769754698.157922:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771698 committed batchid 25769803858 00010000:00010000:2.0:1769754698.157923:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1769754698.157931:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 2/0,0 mode: --/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157936:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae1362f000/0x98cc23d8b84976bd lrc: 0/0,0 mode: --/TXN res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157951:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157956:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157961:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157966:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f05c00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754698.157969:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157974:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157981:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x5a11b149 (ffff94ae017cd800) 00010000:00010000:2.0:1769754698.157983:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769754698.157986:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 2/0,0 mode: --/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.157991:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b84976ee lrc: 0/0,0 mode: --/TXN res: [0x200003ab1:0x9:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1769754698.158013:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803858 00000100:00100000:2.0:1769754698.158501:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94ae02b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238474368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1769754698.158619:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754698.159324:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238474368 00000100:00100000:2.0:1769754698.159335:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238474368 00000100:00100000:2.0:1769754698.162847:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1769754698.162869:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238474368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1769754698.162905:0:55328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:227 count 1 00002000:00010000:2.0:1769754698.162941:0:55328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xe3:0x0] initial LVB size: 1024, mtime: 0x697c5045, atime: 0x697c5045, ctime: 0x697c5045, blocks: 0x8 00010000:00010000:2.0:1769754698.162949:0:55328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.162965:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769754698.162967:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769754698.162973:0:55328:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.162989:0:55328:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.162999:0:55328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.163006:0:55328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754698.163027:0:55328:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1769754698.163482:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1855720238474368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 619us (4861us total) trans 34359738380 rc 0/0 00000100:00100000:2.0:1769754698.163491:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1769754698.164111:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1769754698.164754:0:53842:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1769754698.164765:0:53842:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754698.164778:0:53842:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f05400 already unused, calling callback (ffffffffc0ed6360) 00010000:00010000:1.0:1769754698.164783:0:53842:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754698.164794:0:53842:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754698.164817:0:53842:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754698.164825:0:53842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f6771d5/0x98cc23d8b84977e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754698.164856:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1769754698.164858:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1769754698.164860:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754698.166949:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738379 gen 2 00000004:00080000:0.0:1769754698.166962:0:3658:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 34359738379 committed transno 34359738379 00000100:00100000:0.0:1769754698.166992:0:3658:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff94ae02b56300 x1855720238474368/t34359738380(34359738380) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1769754714 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1769754698.167005:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ae02b56300/2, rc 0, transno 34359738380 00000100:00100000:0.0:1769754698.167010:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94ae02b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238474368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1769754698.571703:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571782:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571810:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754698.571919:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214236800 00000100:00100000:0.0:1769754698.571932:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214236800 00000100:00100000:0.0:1769754698.571993:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214236672 00000100:00100000:0.0:1769754698.571997:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214236672 00000100:00100000:0.0:1769754698.572017:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1769754698.572026:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2403:x1855720214236800:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754698.572118:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2403:x1855720214236800:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754698.572127:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1769754698.572144:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:0.0:1769754698.572151:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2403:x1855720214236672:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754698.572174:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2403:x1855720214236672:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754698.572181:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:1.0:1769754698.572336:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214236544 00000100:00100000:1.0:1769754698.572341:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214236544 00000100:00100000:1.0:1769754698.572381:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214237056 00000100:00100000:1.0:1769754698.572385:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214237056 00000100:00100000:1.0:1769754698.572397:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214236416 00000100:00100000:1.0:1769754698.572400:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214236416 00000100:00100000:1.0:1769754698.572412:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214236928 00000100:00100000:1.0:1769754698.572414:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214236928 00000100:00100000:1.0:1769754698.572439:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:1.0:1769754698.572445:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2403:x1855720214236544:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1769754698.572495:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2403:x1855720214236544:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 50us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754698.572502:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:1.0:1769754698.572514:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:1.0:1769754698.572520:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2403:x1855720214237056:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1769754698.572542:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2403:x1855720214237056:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754698.572570:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:1.0:1769754698.572583:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:1.0:1769754698.572590:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2403:x1855720214236416:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1769754698.572618:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2403:x1855720214236416:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754698.572625:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:1.0:1769754698.572636:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:1.0:1769754698.572642:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2403:x1855720214236928:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1769754698.572677:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2403:x1855720214236928:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754698.572684:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00080000:1.0:1769754698.572707:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769754698.572711:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1769754698.572715:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1769754698.572716:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0F:1769754698.573229:0:53846:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214236288 00000100:00100000:3.0:1769754698.573241:0:53846:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214236288 00000100:00100000:3.0:1769754698.573282:0:53846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1769754698.573290:0:53846:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2403:x1855720214236288:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1769754698.573331:0:53846:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2403:x1855720214236288:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 43us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754698.573337:0:53846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00010000:00010000:1.0:1769754699.110736:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754699.174883:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af06693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238474496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769754699.174960:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754699.175089:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238474496 00000100:00100000:3.0:1769754699.175099:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238474496 00000100:00100000:3.0:1769754699.175163:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1769754699.175184:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1855720238474496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1769754699.175212:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3824308224 avail 3592785920 00000100:00100000:3.0:1769754699.175260:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1855720238474496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754699.175268:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1769754699.175316:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af06693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238474496:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1769754699.175459:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769754699.687053:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238474880:0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.687094:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238474752:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.687131:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754699.687136:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754699.687193:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238475264:0@lo:400:kworker.0 00000100:00100000:1.0:1769754699.687206:0:55326:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238474880 00000100:00100000:1.0:1769754699.687216:0:55326:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238474880 00000100:00100000:3.0:1769754699.687254:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94ae02b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a13ee795-4761-483e-b23a-f08e958dcf18:3660:1855720238474624:0@lo:400:kworker.0 00000100:00100000:1.0:1769754699.687271:0:55326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1769754699.687288:0:55326:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1855720238474880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.688745:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238475392:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.688792:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754699.688820:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1855720238475904:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.688859:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754699.688891:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1769754699.688897:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1855720238475008:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.688919:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754699.689015:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1855720238475520:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.689038:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754699.689057:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1855720238476032:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.689074:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754699.689109:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475904 00000100:00100000:0.0:1769754699.689156:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754699.689179:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1855720238475776:0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689199:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754699.689207:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475904 00000100:00100000:0.0:1769754699.689223:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238474752 00000100:00100000:0.0:1769754699.689229:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238474752 00000100:00100000:2.0:1769754699.689267:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475008 00000100:00100000:2.0:1769754699.689272:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475008 00000100:00100000:0.0:1769754699.689273:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1769754699.689283:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.689293:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475520 00000100:00100000:2.0:1769754699.689297:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475520 00000100:00100000:2.0:1769754699.689310:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238476032 00000100:00100000:2.0:1769754699.689313:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238476032 00000100:00100000:0.0:1769754699.689333:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238474752:12345-0@lo:400:kworker.0 Request processed in 51us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.689371:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1769754699.689406:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475392 00000100:00100000:0.0:1769754699.689409:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475392 00000100:00100000:0.0:1769754699.689425:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475264 00000100:00100000:0.0:1769754699.689427:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475264 00000100:00100000:0.0:1769754699.689439:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1769754699.689444:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238475392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689565:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238475392:12345-0@lo:400:kworker.0 Request processed in 119us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.689571:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1769754699.689582:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1769754699.689587:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238475264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689611:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238475264:12345-0@lo:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.689616:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1769754699.689651:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238474752:0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689662:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238475264:0@lo:400:kworker.0 00000100:00080000:0.0:1769754699.689722:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1769754699.689728:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1769754699.689731:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1769754699.689733:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1769754699.689745:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475776 00000100:00100000:0.0:1769754699.689750:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1769754699.689751:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475776 00000100:00100000:0.0:1769754699.689761:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1855720238475904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.689789:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1769754699.689798:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1855720238475904:12345-0@lo:400:kworker.0 Request processed in 40us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754699.689800:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1855720238475008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689809:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1769754699.689827:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1769754699.689834:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1855720238475520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689863:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1855720238475520:12345-0@lo:400:kworker.0 Request processed in 31us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.689869:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1769754699.689878:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1769754699.689884:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1855720238476032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.689905:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1855720238476032:12345-0@lo:400:kworker.0 Request processed in 22us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.689910:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1769754699.689922:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1769754699.689928:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1855720238475776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.689950:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1855720238475008:12345-0@lo:400:kworker.0 Request processed in 151us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754699.689958:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1769754699.689969:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1855720238475776:12345-0@lo:400:kworker.0 Request processed in 39us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.689978:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1769754699.689987:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1769754699.690014:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1855720238475008:0@lo:400:kworker.0 00000100:00100000:0.0:1769754699.690021:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1855720238475776:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.690032:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1855720238475520:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.690045:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1855720238476032:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.690056:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 34359738377 gen 2 00000004:00080000:2.0:1769754699.690064:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94af30efb800, transno 34359738377 00000100:00100000:2.0:1769754699.690076:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238475392:0@lo:400:kworker.0 00000100:00100000:2.0:1769754699.690085:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1855720238475904:0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.691543:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754699.691592:0:53848:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238474624 00000100:00100000:1.0:1769754699.691600:0:53848:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238474624 00000100:00100000:3.0:1769754699.691605:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238475136:0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.691640:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754699.691664:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475136 00000100:00100000:3.0:1769754699.691668:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475136 00000100:00100000:3.0:1769754699.691697:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1769754699.691705:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3660:x1855720238475136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.691748:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3660:x1855720238475136:12345-0@lo:400:kworker.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754699.691769:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1769754699.691808:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238475136:0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.691814:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1855720238475648:0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.691837:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754699.691846:0:53848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1769754699.691857:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238475648 00000100:00100000:1.0:1769754699.691858:0:53848:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3660:x1855720238474624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.691861:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238475648 00000100:00100000:3.0:1769754699.691900:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1769754699.691905:0:53848:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3660:x1855720238474624:12345-0@lo:400:kworker.0 Request processed in 49us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754699.691913:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1855720238475648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754699.691917:0:53848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1769754699.691951:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1855720238475648:12345-0@lo:400:kworker.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754699.691960:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1769754699.691990:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1855720238475648:0@lo:400:kworker.0 00000100:00100000:3.0:1769754699.692011:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94ae02b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a13ee795-4761-483e-b23a-f08e958dcf18:3660:1855720238474624:0@lo:400:kworker.0 00000100:00080000:2.0:1769754699.694188:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1769754699.694309:0:55326:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1855720238474880:12345-0@lo:400:kworker.0 Request processed in 7025us (7174us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754699.694321:0:55326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1769754699.694410:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238474880:0@lo:400:kworker.0 00010000:00010000:1.0:1769754700.135052:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754700.199140:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1769754700.199174:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af06666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238476160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1769754700.199254:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754700.199398:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238476160 00000100:00100000:3.0:1769754700.199407:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238476160 00000100:00100000:3.0:1769754700.199465:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1769754700.199475:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238476160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769754700.199500:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3824308224 avail 3592785920 00000100:00100000:3.0:1769754700.199562:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238476160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754700.199571:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1769754700.199881:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af06666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238476160:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1769754701.160223:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754701.223003:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1769754701.223031:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238476288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1769754701.223092:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754701.223152:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238476288 00000100:00100000:0.0:1769754701.223161:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238476288 00000100:00100000:0.0:1769754701.223219:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1769754701.223229:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1855720238476288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1769754701.223255:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3776659456 avail 3545137152 00000100:00100000:0.0:1769754701.223297:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1855720238476288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754701.223302:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1769754701.223354:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238476288:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1769754701.223518:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769754701.223987:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1769754701.223997:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1855720238476416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769754701.224025:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754701.224286:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238476416 00000100:00100000:3.0:1769754701.224290:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238476416 00000100:00100000:3.0:1769754701.224336:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1769754701.224351:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1855720238476416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1769754701.224378:0:53859:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446084608 avail 1299845120 00000100:00100000:3.0:1769754701.224416:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1855720238476416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754701.224422:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1769754701.224543:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1855720238476416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1769754701.228318:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1769754701.228786:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af06664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238476544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1769754701.228937:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754701.229054:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238476544 00000100:00100000:3.0:1769754701.229062:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238476544 00000100:00100000:3.0:1769754701.229234:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1769754701.229245:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238476544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769754701.229267:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3776659456 avail 3545137152 00000100:00100000:3.0:1769754701.229311:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238476544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754701.229319:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1769754701.229382:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af06664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238476544:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1769754701.229535:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1769754701.670714:0:54591:0:(llog.c:797:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1769754701.670723:0:54591:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1769754701.670744:0:54591:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 2 count 2 00000040:00080000:0.0:1769754701.670755:0:54591:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1769754701.738014:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1769754701.738034:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af06664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238476672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1769754701.738103:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754701.738149:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238476672 00000100:00100000:3.0:1769754701.738157:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238476672 00000100:00100000:3.0:1769754701.738219:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1769754701.738228:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238476672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1769754701.738261:0:54578:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446244352 avail 1300004864 00000100:00100000:3.0:1769754701.738300:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238476672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754701.738307:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1769754701.738380:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af06664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238476672:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1769754702.182726:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754702.936002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754702.936053:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214237312 00000100:00100000:2.0:1769754702.936064:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214237312 00000100:00080000:3.0:1769754702.936146:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1769754702.936152:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1769754702.936164:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae03c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:51996:x1855720214237312:12345-192.168.202.41@tcp:103:lctl.0 00010000:00010000:2.0:1769754702.936181:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769754702.936206:0:53840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031400/0x98cc23d8b84977dc lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ac9b expref: 7 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754702.936224:0:53840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94af3d404000) 00010000:00010000:2.0:1769754702.936233:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769754702.936305:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae03c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:51996:x1855720214237312:12345-192.168.202.41@tcp:103:lctl.0 Request processed in 143us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754702.936323:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1769754702.941019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754702.941290:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214237440 00000100:00100000:0.0:1769754702.941300:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214237440 00000100:00100000:0.0:1769754702.941372:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:0.0:1769754702.941382:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:51996:x1855720214237440:12345-192.168.202.41@tcp:58:lctl.0 00010000:00010000:0.0:1769754702.941498:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.941517:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.941529:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1769754702.946687:0:55349:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1769754702.946718:0:55349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 64 off8640 00000040:00080000:0.0:1769754702.946878:0:55349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].1, 136 off8328 00000100:00100000:0.0:1769754702.946985:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:51996:x1855720214237440:12345-192.168.202.41@tcp:58:lctl.0 Request processed in 5599us (5970us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754702.946997:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:1.0:1769754702.950392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754702.950505:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214237568 00000100:00100000:0.0:1769754702.950516:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214237568 00000100:00100000:0.0:1769754702.950605:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:0.0:1769754702.950617:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:51996:x1855720214237568:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:0.0:1769754702.950638:0:55349:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754702.950748:0:55349:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4aca2 expref: -99 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.950812:0:55349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.950826:0:55349:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 7 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.951087:0:55349:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.951104:0:55349:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 7 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.951118:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94ae0149f300) 00010000:00010000:0.0:1769754702.951122:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1769754702.951126:0:55349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 7 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754702.951146:0:55349:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00030400, rc 0) 00000100:00100000:0.0:1769754702.951574:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:51996:x1855720214237568:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 958us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754702.951582:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 158 00010000:00010000:0.0:1769754703.206796:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1769754703.590855:0:53890:0:(llog.c:797:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1769754703.590868:0:53890:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769754703.590918:0:53890:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x30:0x0] index 2 count 2 00000040:00080000:3.0:1769754703.590928:0:53890:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1769754703.591059:0:53890:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af06667480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:53890:1855720238476800:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1769754703.591192:0:53890:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af20405240 going to sleep for 11 seconds 00000100:00100000:3.0:1769754703.610958:0:53890:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af06667480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:53890:1855720238476800:192.168.202.41@tcp:107:hsm_cdtr.0 00000020:00080000:0.0:1769754703.624112:0:53834:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771698 batchid updated 00000100:00100000:1.0:1769754703.624745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.624904:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214237696 00000100:00100000:0.0:1769754703.624915:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214237696 00000100:00100000:0.0:1769754703.624975:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:0.0:1769754703.624985:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:52006:x1855720214237696:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1769754703.625020:0:55349:0:(mdt_handler.c:7932:mdt_fid2path()) path get [0x200003ab1:0xa:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1769754703.625155:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:52006:x1855720214237696:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 171us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.625164:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 159 00000020:00080000:3.0:1769754703.626534:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771698 00000020:00080000:3.0:1769754703.626579:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771698 00000100:00100000:1.0:1769754703.640853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.640951:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214237824 00000100:00100000:3.0:1769754703.640961:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214237824 00000100:00100000:3.0:1769754703.641020:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:3.0:1769754703.641038:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:52006:x1855720214237824:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1769754703.641113:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641131:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641143:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641155:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641162:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641183:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641209:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641217:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641224:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1769754703.641267:0:53854:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 1024 00000004:00200000:3.0:1769754703.641271:0:53854:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1769754703.641283:0:53854:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641294:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641312:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641321:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641327:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a7600 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:3.0:1769754703.641331:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641338:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641355:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94af2d215000) 00010000:00010000:3.0:1769754703.641358:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769754703.641363:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641369:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7600/0x98cc23d8b84977f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641387:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641394:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641400:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641405:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a7000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:3.0:1769754703.641408:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641413:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641419:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2aeacae1 (ffff94af2d215d00) 00010000:00010000:3.0:1769754703.641421:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769754703.641424:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641429:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b84977ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2aeacae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641461:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641469:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641475:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641480:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a6800 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:3.0:1769754703.641484:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641491:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641499:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94ae0149f300) 00010000:00010000:3.0:1769754703.641501:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769754703.641504:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.641510:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b8497806 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754703.641633:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:52006:x1855720214237824:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 604us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.641649:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:2.0:1769754703.651123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.651224:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238080 00000100:00100000:0.0:1769754703.651235:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238080 00000100:00100000:0.0:1769754703.651296:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:0.0:1769754703.651315:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:52006:x1855720214238080:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1769754703.651337:0:55349:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754703.651360:0:55349:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b849780d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4aca9 expref: -99 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651488:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651504:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651537:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754703.651587:0:55349:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 1024 00010000:00010000:0.0:1769754703.651689:0:55349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651696:0:55349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651703:0:55349:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651709:0:55349:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af00030a00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754703.651713:0:55349:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651721:0:55349:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651732:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94ae0149f300) 00010000:00010000:0.0:1769754703.651735:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1769754703.651739:0:55349:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651746:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497814 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651786:0:55349:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b849780d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca9 expref: 9 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651807:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:0.0:1769754703.651809:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1769754703.651813:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b849780d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca9 expref: 9 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.651829:0:55349:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00031000, rc 0) 00000100:00100000:0.0:1769754703.651876:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214238080:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 564us (764us total) trans 34359738450 rc 301/301 00000100:00100000:0.0:1769754703.651884:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:1.0:1769754703.659227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.660136:0:53858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238208 00000100:00100000:3.0:1769754703.660147:0:53858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238208 00000100:00100000:3.0:1769754703.660206:0:53858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:3.0:1769754703.660228:0:53858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214238208:12345-192.168.202.41@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1769754703.660372:0:53858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214238208:12345-192.168.202.41@tcp:49:lhsmtool_posix.0 Request processed in 145us (1156us total) trans 0 rc -61/-61 00000100:00100000:3.0:1769754703.660380:0:53858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:1.0:1769754703.670986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.671933:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238336 00000100:00100000:3.0:1769754703.671944:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238336 00000100:00100000:3.0:1769754703.672019:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:3.0:1769754703.672028:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214238336:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1769754703.672070:0:53854:0:(mdt_handler.c:7932:mdt_fid2path()) path get [0x200003ab1:0xa:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1769754703.672188:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214238336:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 161us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.672196:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:2.0:1769754703.686446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.687159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.687246:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238464 00000100:00100000:0.0:1769754703.687256:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238464 00000100:00100000:0.0:1769754703.687328:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1769754703.687338:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214238464:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1769754703.687357:0:55349:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754703.687377:0:55349:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b8497822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acb0 expref: -99 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.687465:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.687480:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.687491:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.687505:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.687537:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.687545:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.687912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.687941:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.687959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.687974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.687993:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.688011:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214239104 00000100:00100000:2.0:1769754703.688014:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214239104 00000100:00100000:2.0:1769754703.688045:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238720 00000100:00100000:2.0:1769754703.688048:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238720 00000100:00100000:2.0:1769754703.688070:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214239232 00000100:00100000:2.0:1769754703.688072:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214239232 00000100:00100000:2.0:1769754703.688088:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1769754703.688095:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2402:x1855720214239104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1769754703.688150:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2402:x1855720214239104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.688158:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1769754703.688173:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:2.0:1769754703.688178:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214238720:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1769754703.688201:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214238720:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.688207:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:2.0:1769754703.688224:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1769754703.688229:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2402:x1855720214239232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1769754703.688249:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2402:x1855720214239232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.688256:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1769754703.688275:0:55327:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238848 00000100:00100000:2.0:1769754703.688277:0:55327:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238848 00000100:00100000:2.0:1769754703.688315:0:55327:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238976 00000100:00100000:2.0:1769754703.688318:0:55327:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238976 00000100:00100000:2.0:1769754703.688337:0:55327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1769754703.688343:0:55327:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2402:x1855720214238848:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1769754703.688365:0:55327:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2402:x1855720214238848:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.688371:0:55327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1769754703.688381:0:55327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:2.0:1769754703.688386:0:55327:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214238976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1769754703.688414:0:55327:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214238976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 17us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.688420:0:55327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00080000:2.0:1769754703.688436:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1769754703.688440:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1769754703.688443:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1769754703.688445:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1769754703.688677:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031400/0x98cc23d8b8497837 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688689:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031400/0x98cc23d8b8497837 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688699:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031400/0x98cc23d8b8497837 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754703.688740:0:55349:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0x9:0x0]: returning size 4096 00000004:00200000:0.0:1769754703.688744:0:55349:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1769754703.688763:0:55349:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031400/0x98cc23d8b8497837 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688777:0:55349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688785:0:55349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688791:0:55349:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688797:0:55349:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af00030a00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754703.688802:0:55349:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688819:0:55349:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688830:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754703.688833:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754703.688838:0:55349:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688845:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b8497829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688859:0:55349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688865:0:55349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688871:0:55349:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688876:0:55349:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af00030200 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754703.688879:0:55349:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688885:0:55349:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688891:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff94af3d404c00) 00010000:00010000:0.0:1769754703.688893:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754703.688895:0:55349:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688909:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497830 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688941:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b8497822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acb0 expref: 10 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688955:0:55349:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031400/0x98cc23d8b8497837 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acb0 expref: 9 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.688962:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff94af3d404e00) 00010000:00010000:0.0:1769754703.688965:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1769754703.688967:0:55349:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00031400, rc 0) 00000100:00100000:0.0:1769754703.688988:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52006:x1855720214238464:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1653us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.688995:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:3.0:1769754703.701349:0:53846:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214238592 00000100:00100000:3.0:1769754703.701365:0:53846:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214238592 00000100:00100000:3.0:1769754703.701421:0:53846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:3.0:1769754703.701444:0:53846:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2402:x1855720214238592:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1769754703.701860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754703.701885:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214239488 00000100:00100000:1.0:1769754703.701888:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214239488 00000100:00100000:1.0:1769754703.701916:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1769754703.701923:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52006:x1855720214239488:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1769754703.701941:0:53854:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769754703.701972:0:53854:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849783e lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acb7 expref: -99 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1769754703.702346:0:53854:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xe3:0x0], index 0: 0 00010000:00010000:1.0:1769754703.702800:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b8497845 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.702816:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b8497845 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.702827:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b8497845 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.702881:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849783e lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acb7 expref: 12 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.702900:0:53854:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b8497845 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acb7 expref: 11 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.702909:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94af132eeb00) 00010000:00010000:1.0:1769754703.702912:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769754703.702914:0:53854:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af421e0200, rc 0) 00000100:00100000:1.0:1769754703.702977:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52006:x1855720214239488:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1053us (1117us total) trans 34359738451 rc 0/0 00000100:00100000:1.0:1769754703.702985:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:3.0:1769754703.703928:0:53846:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2402:x1855720214238592:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 2491us (16764us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.703939:0:53846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:1.0:1769754703.719966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.720477:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214239744 00000100:00100000:2.0:1769754703.720487:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214239744 00000100:00100000:2.0:1769754703.721891:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:2.0:1769754703.721909:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52006:x1855720214239744:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.721976:0:53854:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769754703.722003:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b8497845 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acb7 expref: 11 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722021:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94af132eeb00) 00010000:00010000:2.0:1769754703.722183:0:53854:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1769754703.722207:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722221:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722232:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722246:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722252:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722259:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722312:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722319:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722326:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722338:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f04a00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754703.722343:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722351:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722359:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff94af3d404e00) 00010000:00010000:2.0:1769754703.722362:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769754703.722366:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722372:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497853 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722382:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722388:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722394:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722399:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f05c00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754703.722402:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722408:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722434:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x880dee75 (ffff94ae017cdf00) 00010000:00010000:2.0:1769754703.722437:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769754703.722441:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.722446:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b849785a lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x880dee75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.726795:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+10:52006:x1855720214239744:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 4881us (6824us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769754703.726810:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1769754703.734336:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.734415:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214239872 00000100:00100000:2.0:1769754703.734434:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214239872 00000100:00100000:2.0:1769754703.734496:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:2.0:1769754703.734505:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+10:52006:x1855720214239872:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.734534:0:53854:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769754703.734575:0:53854:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05400/0x98cc23d8b8497861 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acbe expref: -99 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.734609:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.734623:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.734634:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.734952:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05400/0x98cc23d8b8497861 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 12 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.734974:0:53854:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 11 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.734990:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:2.0:1769754703.734994:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1769754703.734997:0:53854:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae02f05e00, rc 0) 00000100:00100000:2.0:1769754703.735059:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52006:x1855720214239872:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 554us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.736340:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:3.0:1769754703.745240:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754703.746167:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214240128 00000100:00100000:1.0:1769754703.746178:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214240128 00000100:00100000:1.0:1769754703.746242:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:1.0:1769754703.746251:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52006:x1855720214240128:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1769754703.746358:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.746377:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.746390:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1769754703.746663:0:55349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].3, 88 off8408 00000004:00080000:1.0:1769754703.746673:0:55349:0:(osp_sync.c:1841:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2058684123304ns, next at 2059684121101ns, rc = 0 00000004:00010000:1.0:1769754703.746724:0:55349:0:(mdt_handler.c:4458:mdt_save_lock()) ### save lock request 0000000079396080 reply state 0000000016545d70 transno 34359738452 ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.746737:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.746746:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:1.0:1769754703.746749:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1769754703.746753:0:55349:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1769754703.746867:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52006:x1855720214240128:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 616us (1636us total) trans 34359738452 rc 0/0 00000100:00100000:1.0:1769754703.746875:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:3.0:1769754703.751097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.752178:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214240256 00000100:00100000:0.0:1769754703.752191:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214240256 00000100:00100000:0.0:1769754703.752254:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:0.0:1769754703.752263:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52006:x1855720214240256:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1769754703.752287:0:53854:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754703.752319:0:53854:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acc5 expref: -99 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.752393:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 14 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.752407:0:53854:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 14 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.752436:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:0.0:1769754703.752440:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1769754703.752444:0:53854:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae0ab8a600, rc 0) 00000100:00100000:0.0:1769754703.752518:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:52006:x1855720214240256:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 256us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.752532:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:1.0:1769754703.765853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.765942:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214240384 00000100:00100000:2.0:1769754703.765952:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214240384 00000100:00100000:2.0:1769754703.766008:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:2.0:1769754703.766018:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2403:x1855720214240384:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1769754703.766240:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2403:x1855720214240384:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 222us (395us total) trans 34359738376 rc 0/0 00000100:00100000:2.0:1769754703.766247:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:1.0:1769754703.771965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.772053:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214240640 00000100:00100000:0.0:1769754703.772063:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214240640 00000100:00100000:0.0:1769754703.772122:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1769754703.772131:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3c966050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:52006:x1855720214240640:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1769754703.772384:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3c966050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+15:52006:x1855720214240640:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 252us (426us total) trans 34359738453 rc 0/0 00000100:00100000:0.0:1769754703.772393:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1769754703.776417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.782288:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214240896 00000100:00100000:2.0:1769754703.782312:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214240896 00000100:00100000:2.0:1769754703.782442:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:2.0:1769754703.782467:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+15:52006:x1855720214240896:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1769754703.782655:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+15:52006:x1855720214240896:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 203us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.782663:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 169 00000001:00080000:1.0:1769754703.790950:0:56128:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 34359738380 is committed 00000100:00100000:1.0:1769754703.806040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.806149:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241024 00000100:00100000:2.0:1769754703.806161:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241024 00000100:00100000:2.0:1769754703.806230:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 170 00000100:00100000:2.0:1769754703.806240:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+15:52006:x1855720214241024:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.806276:0:53855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769754703.806308:0:53855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05400/0x98cc23d8b849787d lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4accc expref: -99 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.806392:0:53855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b8497884 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.806408:0:53855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b8497884 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.806421:0:53855:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b8497884 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1769754703.806481:0:53855:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1769754703.806503:0:53855:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b8497884 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.806530:0:53855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05400/0x98cc23d8b849787d lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4accc expref: 17 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.806605:0:53855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b8497884 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4accc expref: 16 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.806614:0:53855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:2.0:1769754703.806617:0:53855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1769754703.806621:0:53855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae02f05c00, rc 0) 00000100:00100000:2.0:1769754703.806681:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52006:x1855720214241024:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 442us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.806689:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 170 00000100:00100000:1.0:1769754703.821799:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.821899:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241152 00000100:00100000:0.0:1769754703.821910:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241152 00000100:00100000:0.0:1769754703.821972:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:0.0:1769754703.821982:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2403:x1855720214241152:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1769754703.822000:0:56217:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754703.822039:0:56217:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acd3 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1769754703.822076:0:56217:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x697c5050, blocks: 0x0 00010000:00010000:0.0:1769754703.822097:0:56217:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769754703.822100:0:56217:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769754703.822108:0:56217:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 8 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.822125:0:56217:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 8 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.822140:0:56217:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae0ab8b600, rc 0) 00000100:00100000:0.0:1769754703.822198:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2403:x1855720214241152:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 218us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.822206:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1769754703.824832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.824928:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241408 00000100:00100000:2.0:1769754703.824937:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241408 00000100:00100000:2.0:1769754703.824998:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:2.0:1769754703.825007:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52006:x1855720214241408:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1769754703.825117:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52006:x1855720214241408:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.825126:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:1.0:1769754703.830810:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.830989:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241536 00000100:00100000:2.0:1769754703.830999:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241536 00000100:00100000:2.0:1769754703.831056:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1769754703.831074:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52006:x1855720214241536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.831094:0:55328:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769754703.831114:0:55328:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acda expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.831151:0:55328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.831159:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769754703.831162:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769754703.831167:0:55328:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 9 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.831204:0:55328:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.831217:0:55328:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.831244:0:55328:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3ea5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:55328:1855720238476928:192.168.202.41@tcp:104: 00000100:00100000:2.0:1769754703.831336:0:55328:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11d3e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769754703.834312:0:55328:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3ea5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:55328:1855720238476928:192.168.202.41@tcp:104: 00010000:00010000:2.0:1769754703.834702:0:55328:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 9 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.834724:0:55328:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae02f05400, rc 0) 00000100:00100000:2.0:1769754703.834788:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52006:x1855720214241536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 3715us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.834798:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1769754703.837137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.837343:0:53841:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241664 00000100:00100000:0.0:1769754703.837354:0:53841:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241664 00010000:00010000:0.0:1769754703.837397:0:53841:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.837459:0:53841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:0.0:1769754703.837469:0:53841:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af06666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:2403:x1855720214241664:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769754703.837484:0:53841:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769754703.837508:0:53841:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.837544:0:53841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.837611:0:53841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4055a3c/0x98cc23d8b849788b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acd3 expref: 9 pid: 56217 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.837631:0:53841:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769754703.837634:0:53841:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769754703.837641:0:53841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.837651:0:53841:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.837690:0:53841:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.837703:0:53841:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f10c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:53841:1855720238477056:192.168.202.41@tcp:105: 00000100:00100000:0.0:1769754703.837767:0:53841:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae03250000 going to sleep for 11 seconds 00000100:00100000:3.0:1769754703.843012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.843132:0:53841:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f10c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:53841:1855720238477056:192.168.202.41@tcp:105: 00010000:00010000:0.0:1769754703.843158:0:53841:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769754703.843226:0:53841:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af06666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2403:x1855720214241664:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 5758us (6099us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.843237:0:53841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1769754703.844037:0:55332:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241792 00000100:00100000:2.0:1769754703.844045:0:55332:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241792 00002000:00100000:2.0:1769754703.844099:0:55332:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xe3:0x0] (0->1023) req@ffff94ae02b57b80 x1855720214241792/t0(0) o4->0c0f1214-0730-446f-804c-1ee9dc41ddf3@192.168.202.41@tcp:739/0 lens 1512/0 e 0 to 0 dl 1769754714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769754703.844115:0:55332:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94ae02b57b80 with x1855720214241792 ext(0->1023) 00002000:00010000:2.0:1769754703.844123:0:55332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94ae02b57b80 00000100:00100000:2.0:1769754703.844151:0:55332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1769754703.844159:0:55332:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae02b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2403:x1855720214241792:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1769754703.845801:0:55332:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae02b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+10:2403:x1855720214241792:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 1634us (2789us total) trans 34359738377 rc 0/0 00000100:00100000:2.0:1769754703.845812:0:55332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00002000:00100000:2.0:1769754703.845823:0:55332:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xe3:0x0] (0->1023) req@ffff94ae02b57b80 x1855720214241792/t34359738377(0) o4->0c0f1214-0730-446f-804c-1ee9dc41ddf3@192.168.202.41@tcp:739/0 lens 1512/448 e 0 to 0 dl 1769754714 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769754703.845842:0:55332:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94ae02b57b80 with x1855720214241792 ext(0->1023) 00002000:00010000:2.0:1769754703.845847:0:55332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94ae02b57b80 00000100:00100000:3.0:1769754703.855508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.855814:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214241920 00000100:00100000:2.0:1769754703.855824:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214241920 00000100:00100000:2.0:1769754703.855885:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1769754703.855895:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae02b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52006:x1855720214241920:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1769754703.857662:0:53834:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738453 is committed 00000004:00080000:0.0:1769754703.857678:0:53834:0:(osp_sync.c:1806:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:2.0:1769754703.857722:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.857736:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.857745:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.857752:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af421e1a00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754703.857757:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.857764:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.857780:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:2.0:1769754703.857783:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1769754703.857788:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 2/0,0 mode: --/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.857795:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b849786f lrc: 0/0,0 mode: --/TXN res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.857964:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae02b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52006:x1855720214241920:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 2066us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.857974:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1769754703.858395:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238477184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1769754703.858464:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754703.858622:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238477184 00000100:00100000:1.0:1769754703.858637:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238477184 00000100:00100000:1.0:1769754703.858684:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1769754703.858691:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238477184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1769754703.858820:0:55328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1769754703.858824:0:55328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb mtime from disk: 0 -> 1769754704 00002000:00010000:1.0:1769754703.858826:0:55328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1769754703.858829:0:55328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb ctime from disk: 1769754704 -> 1769754704 00002000:00010000:1.0:1769754703.858832:0:55328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1769754703.858868:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1855720238477184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (417us total) trans 34359738378 rc 0/0 00000100:00100000:1.0:1769754703.858875:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1769754703.858910:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94af20abca80/2, rc 0, transno 34359738378 00000100:00100000:1.0:1769754703.858915:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238477184:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1769754703.858997:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769754703.861388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.861518:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214242048 00000100:00100000:0.0:1769754703.861528:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214242048 00000100:00100000:0.0:1769754703.861679:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:0.0:1769754703.861689:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+10:2402:x1855720214242048:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1769754703.863163:0:55322:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 34359738378 is committed 00000001:00080000:0.0:1769754703.863175:0:55322:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 34359738377 is committed 00000100:00100000:1.0:1769754703.863358:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2402:x1855720214242048:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 1666us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754703.863368:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:3.0:1769754703.866693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.866789:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214242304 00000100:00100000:2.0:1769754703.866800:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214242304 00000100:00100000:2.0:1769754703.866885:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:2.0:1769754703.866895:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52006:x1855720214242304:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.866947:0:53854:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769754703.866973:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05c00/0x98cc23d8b8497884 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4accc expref: 11 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.866993:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:2.0:1769754703.866997:0:53854:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1769754703.867024:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867050:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867060:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867083:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867107:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867115:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867122:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f04a00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754703.867126:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867134:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867142:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:2.0:1769754703.867144:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769754703.867148:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.867154:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04a00/0x98cc23d8b8497899 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.867258:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+10:52006:x1855720214242304:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 363us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754703.867264:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:0.0:1769754703.872756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.872843:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214242432 00000100:00100000:3.0:1769754703.872853:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214242432 00000100:00100000:3.0:1769754703.872906:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:3.0:1769754703.872915:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2402:x1855720214242432:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1769754703.873081:0:56217:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1769754703.873085:0:56217:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb mtime from disk: 1769754704 -> 1769754693 00002000:00010000:3.0:1769754703.873088:0:56217:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb atime from disk: 0 -> 1769754693 00002000:00010000:3.0:1769754703.873090:0:56217:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb ctime from disk: 1769754704 -> 1769754693 00002000:00010000:3.0:1769754703.873092:0:56217:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xe3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1769754703.873149:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2402:x1855720214242432:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 234us (403us total) trans 34359738379 rc 0/0 00000100:00100000:3.0:1769754703.873156:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:1.0:1769754703.877688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.877761:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214242688 00000100:00100000:2.0:1769754703.877771:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214242688 00000100:00100000:2.0:1769754703.877833:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:2.0:1769754703.877843:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+10:52006:x1855720214242688:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.877912:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.877944:0:53854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 10 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.877954:0:53854:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.877990:0:53854:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 10 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.878004:0:53854:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 10 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.878021:0:53854:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94ae02e4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:53854:1855720238477312:192.168.202.41@tcp:104: 00000100:00100000:2.0:1769754703.878119:0:53854:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11d3e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769754703.883085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.883221:0:53841:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214242816 00000100:00100000:0.0:1769754703.883231:0:53841:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214242816 00010000:00010000:0.0:1769754703.883273:0:53841:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 11 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.883326:0:53841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:0.0:1769754703.883336:0:53841:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3ea23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:2403:x1855720214242816:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769754703.883351:0:53841:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769754703.883358:0:53841:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 11 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.883372:0:53841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 11 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.883394:0:53841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:0.0:1769754703.883400:0:53841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.883410:0:53841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.883443:0:53841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.883471:0:53841:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769754703.883523:0:53841:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3ea23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:2403:x1855720214242816:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 188us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.883531:0:53841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00010000:00010000:2.0:1769754703.883823:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b8497868 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acbe expref: 10 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.883842:0:53854:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94ae02e4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:53854:1855720238477312:192.168.202.41@tcp:104: 00010000:00010000:2.0:1769754703.883862:0:53854:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883871:0:53854:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883876:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883910:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883924:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883930:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883937:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f05000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:2.0:1769754703.883941:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883949:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883959:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:2.0:1769754703.883962:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1769754703.883966:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.883972:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05000/0x98cc23d8b84978a0 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.884023:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52006:x1855720214242688:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 6182us (6345us total) trans 0 rc -22/-22 00000100:00100000:2.0:1769754703.884031:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:3.0:1769754703.903076:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.903336:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214242944 00000100:00100000:0.0:1769754703.903347:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214242944 00000100:00100000:0.0:1769754703.903406:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:0.0:1769754703.903416:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af37dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2403:x1855720214242944:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1769754703.903488:0:55328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.903513:0:55328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.903521:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1769754703.903524:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1769754703.903527:0:55328:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.903611:0:55328:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.903627:0:55328:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 8 pid: 55328 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.903669:0:55328:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f10f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:55328:1855720238477440:192.168.202.41@tcp:104: 00000100:00100000:0.0:1769754703.903755:0:55328:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae03250000 going to sleep for 11 seconds 00000100:00100000:1.0:1769754703.906800:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.906954:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214243072 00000100:00100000:3.0:1769754703.906964:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214243072 00010000:00010000:3.0:1769754703.907003:0:53840:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 9 pid: 55328 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754703.907048:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1769754703.907057:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:2403:x1855720214243072:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769754703.907080:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769754703.907101:0:53840:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 9 pid: 55328 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.907133:0:53840:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 9 pid: 55328 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.907158:0:53840:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754703.907161:0:53840:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754703.907166:0:53840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.907177:0:53840:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.907194:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1769754703.907366:0:55328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f6771d5/0x98cc23d8b8497892 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acda expref: 9 pid: 55328 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.907386:0:55328:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f10f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:55328:1855720238477440:192.168.202.41@tcp:104: 00010000:00010000:0.0:1769754703.907407:0:55328:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907417:0:55328:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907434:0:55328:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907464:0:55328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907473:0:55328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907481:0:55328:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907501:0:55328:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8b400 already unused, calling callback (ffffffffc0ed6360) 00010000:00010000:0.0:1769754703.907505:0:55328:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907515:0:55328:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907527:0:55328:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.907534:0:55328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a574713e/0x98cc23d8b84978a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754703.907828:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2403:x1855720214243072:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 771us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.907838:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1769754703.907892:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af37dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2403:x1855720214242944:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 4477us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.907900:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:1.0:1769754703.918155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754703.918306:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214243328 00000100:00100000:2.0:1769754703.918317:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214243328 00000100:00100000:2.0:1769754703.918379:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00100000:2.0:1769754703.918388:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52006:x1855720214243328:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1769754703.918721:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.918744:0:53854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 10 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.918754:0:53854:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.918786:0:53854:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 10 pid: 53854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754703.918799:0:53854:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 10 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754703.918814:0:53854:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94ae02e4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:53854:1855720238477568:192.168.202.41@tcp:104: 00000100:00100000:2.0:1769754703.918880:0:53854:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae0296d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769754703.921957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.922395:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214243456 00000100:00100000:3.0:1769754703.922404:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214243456 00010000:00010000:3.0:1769754703.922460:0:53840:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 11 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754703.922499:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1769754703.922508:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae0eee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:2402:x1855720214243456:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769754703.922523:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769754703.922529:0:53840:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 11 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.922601:0:53840:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 11 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.922622:0:53840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:3.0:1769754703.922627:0:53840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.922637:0:53840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.922645:0:53840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.922662:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769754703.922707:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae0eee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:2402:x1855720214243456:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 200us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.922716:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00010000:00010000:0.0:1769754703.925226:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b8497876 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acc5 expref: 10 pid: 53854 timeout: 2158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.925250:0:53854:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94ae02e4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:53854:1855720238477568:192.168.202.41@tcp:104: 00010000:00010000:0.0:1769754703.925273:0:53854:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.925373:0:53854:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.925382:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1769754703.925832:0:53854:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738454 00000001:00080000:1.0:1769754703.925938:0:53854:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738455 00000001:00080000:1.0:1769754703.925983:0:53854:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738456 00000100:00100000:1.0:1769754703.926417:0:53854:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:53854:1855720238477696:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1769754703.926769:0:53854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754703.927050:0:53854:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae01d97b40 going to sleep for 11 seconds 00000100:00100000:3.0:1769754703.927151:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238477696 00000100:00100000:3.0:1769754703.927158:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238477696 00000100:00100000:3.0:1769754703.927242:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1769754703.927253:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:53854:x1855720238477696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1769754703.927357:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:53854:x1855720238477696:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.927364:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1769754703.927432:0:53854:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738378 gen 2 00000004:00080000:1.0:1769754703.927438:0:53854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94af20abca80, transno 34359738378 00000100:00100000:1.0:1769754703.927468:0:53854:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:53854:1855720238477696:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1769754703.927619:0:53854:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738457 00000100:00100000:1.0:1769754703.927669:0:53854:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:53854:1855720238477824:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1769754703.927719:0:53854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754703.928209:0:53854:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae01d97780 going to sleep for 11 seconds 00000100:00100000:0.0:1769754703.928284:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238477824 00000100:00100000:0.0:1769754703.928290:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238477824 00000100:00100000:0.0:1769754703.928335:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1769754703.928342:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:53854:x1855720238477824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1769754703.928476:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:53854:x1855720238477824:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (755us total) trans 34359738380 rc 0/0 00000100:00100000:0.0:1769754703.928483:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1769754703.928725:0:53854:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:53854:1855720238477824:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1769754703.928784:0:53854:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738458 00010000:00010000:1.0:1769754703.928807:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928817:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928825:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928832:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae02f05e00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:1.0:1769754703.928836:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928844:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928858:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94ae017cda00) 00010000:00010000:1.0:1769754703.928868:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1769754703.928873:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928880:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05e00/0x98cc23d8b84978ae lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928919:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928925:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928932:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928937:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af00030e00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:1.0:1769754703.928940:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928947:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928955:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94ae0149f300) 00010000:00010000:1.0:1769754703.928957:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1769754703.928965:0:53854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 14 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928978:0:53854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 14 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.928988:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 14 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754703.929042:0:53854:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030400/0x98cc23d8b84977f1 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4aca2 expref: 14 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1769754703.929054:0:53854:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3fc28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:53854:1855720238477952:192.168.202.41@tcp:105: 00000100:00100000:1.0:1769754703.929221:0:53854:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae01d97a80 going to sleep for 11 seconds 00000100:00100000:3.0:1769754703.940999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.941030:0:53858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214243584 00000100:00100000:3.0:1769754703.941038:0:53858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214243584 00000100:00100000:3.0:1769754703.941107:0:53858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:3.0:1769754703.941115:0:53858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+15:51996:x1855720214243584:12345-192.168.202.41@tcp:49:lctl.0 00000100:00100000:3.0:1769754703.941242:0:53858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+15:51996:x1855720214243584:12345-192.168.202.41@tcp:49:lctl.0 Request processed in 127us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754703.941250:0:53858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1769754703.941416:0:53854:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3fc28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:53854:1855720238477952:192.168.202.41@tcp:105: 00010000:00010000:0.0:1769754703.941459:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941471:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84977ea lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941498:0:53854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941512:0:53854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941523:0:53854:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941533:0:53854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941540:0:53854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941575:0:53854:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941582:0:53854:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8b600 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754703.941592:0:53854:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941599:0:53854:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941613:0:53854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94ae0149f300) 00010000:00010000:0.0:1769754703.941616:0:53854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754703.941620:0:53854:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754703.941626:0:53854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978b5 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754703.941749:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:52006:x1855720214243328:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 23362us (23602us total) trans 34359738459 rc 0/0 00000100:00100000:0.0:1769754703.941757:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 175 00000020:00080000:0.0:1769754703.941761:0:53854:0:(tgt_main.c:782:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1769754703.942222:0:53890:0:(llog.c:797:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1769754703.942227:0:53890:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769754703.942242:0:53890:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x30:0x0] index 2 count 2 00000040:00080000:3.0:1769754703.942248:0:53890:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1769754703.952270:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754703.952353:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214243840 00000100:00100000:0.0:1769754703.952364:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214243840 00000100:00100000:0.0:1769754703.952436:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 176 00000100:00100000:0.0:1769754703.952447:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:51996:x1855720214243840:12345-192.168.202.41@tcp:58:lctl.0 00000040:00080000:0.0:1769754703.952631:0:53854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].2, 136 off8464 00000100:00100000:0.0:1769754703.952700:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:51996:x1855720214243840:12345-192.168.202.41@tcp:58:lctl.0 Request processed in 255us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754703.952708:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 176 00000100:00100000:0.0:1769754703.958818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754703.958888:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244096 00000100:00100000:3.0:1769754703.958898:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244096 00000100:00100000:3.0:1769754703.958953:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:3.0:1769754703.958962:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:52006:x1855720214244096:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1769754703.959229:0:53857:0:(mdd_object.c:3993:mdd_close()) Object [0x200003ab1:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1769754703.959256:0:53857:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738460 00010000:00010000:3.0:1769754703.959290:0:53857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959319:0:53857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959332:0:53857:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959341:0:53857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959347:0:53857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959370:0:53857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959389:0:53857:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1769754703.959761:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52006:x1855720214244096:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 798us (951us total) trans 34359738461 rc 0/0 00000100:00100000:3.0:1769754703.959770:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000020:00080000:3.0:1769754703.959775:0:53857:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1769754703.959796:0:53842:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1769754703.959802:0:53842:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959810:0:53842:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a6800 already unused, calling callback (ffffffffc0ed6360) 00010000:00010000:3.0:1769754703.959815:0:53842:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959823:0:53842:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959835:0:53842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff94af2d215b00) 00010000:00010000:3.0:1769754703.959838:0:53842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1769754703.959842:0:53842:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959848:0:53842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a6800/0x98cc23d8b84978bc lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 53857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754703.959861:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769754703.959863:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769754703.959864:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769754704.049210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754704.050236:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244224 00000100:00100000:0.0:1769754704.050248:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244224 00000100:00100000:0.0:1769754704.050343:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 177 00000100:00100000:0.0:1769754704.050368:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:51511:x1855720214244224:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1769754704.050399:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1769754704.050483:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:51511:x1855720214244224:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 118us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.050491:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 177 00000100:00100000:0.0:1769754704.057723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754704.057826:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244352 00000100:00100000:1.0:1769754704.057836:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244352 00000100:00100000:1.0:1769754704.057891:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 178 00000100:00100000:1.0:1769754704.057900:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:51511:x1855720214244352:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1769754704.057997:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:51511:x1855720214244352:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754704.058005:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 178 00000100:00100000:2.0:1769754704.065162:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754704.065243:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244608 00000100:00100000:3.0:1769754704.065253:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244608 00000100:00100000:3.0:1769754704.065318:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1769754704.065328:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:51511:x1855720214244608:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1769754704.066653:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+17:51511:x1855720214244608:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 1322us (1497us total) trans 34359738462 rc 0/0 00000100:00100000:3.0:1769754704.066662:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00010000:00010000:0.0:1769754704.230788:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769754704.295645:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238478080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1769754704.295732:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754704.296055:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478080 00000100:00100000:0.0:1769754704.296066:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478080 00000100:00100000:0.0:1769754704.296120:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1769754704.296130:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1855720238478080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1769754704.296155:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3824308224 avail 3592757248 00000100:00100000:0.0:1769754704.296209:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1855720238478080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.296219:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1769754704.296375:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238478080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1769754704.401283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754704.408758:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244736 00000100:00100000:0.0:1769754704.408775:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244736 00000100:00100000:0.0:1769754704.408850:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 179 00000100:00100000:0.0:1769754704.408860:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:906a5562-67c4-4053-950c-2d0d5d87605b+5:52023:x1855720214244736:12345-192.168.202.41@tcp:101:lsof.0 00010000:00010000:0.0:1769754704.408880:0:53855:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754704.408900:0:53855:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84978c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ace1 expref: -99 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754704.408963:0:53855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754704.408978:0:53855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754704.409008:0:53855:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754704.409054:0:53855:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1769754704.409132:0:53855:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1769754704.409152:0:53855:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 53855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754704.409177:0:53855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84978c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 7 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754704.409196:0:53855:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 6 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754704.409204:0:53855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754704.409207:0:53855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1769754704.409211:0:53855:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae0ab8ba00, rc 0) 00000100:00100000:0.0:1769754704.409276:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:906a5562-67c4-4053-950c-2d0d5d87605b+6:52023:x1855720214244736:12345-192.168.202.41@tcp:101:lsof.0 Request processed in 418us (8003us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.409283:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 179 00000100:00100000:3.0:1769754704.808790:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238478336:0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.808998:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1855720238478592:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.809063:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238478464:0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.810022:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754704.810085:0:53860:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478336 00000100:00100000:2.0:1769754704.810094:0:53860:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478336 00000100:00100000:2.0:1769754704.810153:0:53860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1769754704.810164:0:53860:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1855720238478336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.812852:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754704.813209:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1855720238479104:0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.813247:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754704.813269:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1855720238479616:0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.813328:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754704.813375:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1769754704.813382:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2f232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a13ee795-4761-483e-b23a-f08e958dcf18:3658:1855720238478208:0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.813413:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754704.813447:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238478720:0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.813619:0:53848:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478208 00000100:00100000:0.0:1769754704.813628:0:53848:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478208 00000100:00100000:0.0:1769754704.813677:0:53848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1769754704.813686:0:53848:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3658:x1855720238478208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.814031:0:53848:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3658:x1855720238478208:12345-0@lo:400:kworker.0 Request processed in 345us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.814039:0:53848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1769754704.814077:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478592 00000100:00100000:0.0:1769754704.814081:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478592 00000100:00100000:0.0:1769754704.814112:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479104 00000100:00100000:0.0:1769754704.814115:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479104 00000100:00100000:0.0:1769754704.814128:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479616 00000100:00100000:0.0:1769754704.814130:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479616 00000100:00100000:0.0:1769754704.814152:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1769754704.814158:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2f10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1855720238478592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.814194:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2f10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1855720238478592:12345-0@lo:400:kworker.0 Request processed in 36us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.814200:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1769754704.814212:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1769754704.814217:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae02e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1855720238479104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.814243:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae02e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1855720238479104:12345-0@lo:400:kworker.0 Request processed in 26us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.814249:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1769754704.814270:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1769754704.814275:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae0deddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1855720238479616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.814313:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae0deddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1855720238479616:12345-0@lo:400:kworker.0 Request processed in 39us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.814319:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1769754704.814335:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769754704.818696:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754704.818741:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478464 00000100:00100000:1.0:1769754704.818750:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478464 00000100:00100000:1.0:1769754704.818803:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1769754704.818812:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238478464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.818858:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238478464:12345-0@lo:400:kworker.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754704.818866:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1769754704.818883:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769754704.818914:0:3661:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738380 gen 2 00000004:00080000:1.0:1769754704.818920:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ae02b56300, transno 34359738380 00000100:00100000:1.0:1769754704.818946:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238478464:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.819054:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238478976:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.819081:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754704.819097:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478976 00000100:00100000:1.0:1769754704.819101:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478976 00000100:00100000:1.0:1769754704.819125:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1769754704.819131:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238478976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.819156:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238478976:12345-0@lo:400:kworker.0 Request processed in 26us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754704.819162:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1769754704.819174:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769754704.819188:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238478976:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.819195:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1855720238479488:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.819216:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754704.823106:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238478848:0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.823170:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754704.823205:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478848 00000100:00100000:3.0:1769754704.823213:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478848 00000100:00100000:3.0:1769754704.823268:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1769754704.823276:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1855720238478848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.823332:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1855720238478848:12345-0@lo:400:kworker.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754704.823338:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1769754704.823358:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769754704.823390:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238478848:0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.823398:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1855720238479360:0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.823424:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754704.824656:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479488 00000100:00100000:0.0:1769754704.824665:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479488 00000100:00100000:0.0:1769754704.824707:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479360 00000100:00100000:0.0:1769754704.824710:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479360 00000100:00100000:0.0:1769754704.824736:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1769754704.824744:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1855720238479488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.824797:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1855720238479488:12345-0@lo:400:kworker.0 Request processed in 54us (5579us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.824803:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1769754704.824818:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1769754704.824824:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1855720238479360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754704.824852:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1855720238479360:12345-0@lo:400:kworker.0 Request processed in 28us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754704.824857:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1769754704.825591:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754704.825623:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1855720238479232:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.825652:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754704.825685:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1855720238478592:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.825699:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1855720238479104:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.825709:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1855720238479616:0@lo:400:kworker.0 00000100:00080000:3.0:1769754704.825716:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1769754704.825728:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769754704.825737:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a13ee795-4761-483e-b23a-f08e958dcf18:3658:1855720238478208:0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.825771:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1855720238479360:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.825771:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1855720238479488:0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.825799:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479232 00000100:00100000:1.0:1769754704.825810:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479232 00000100:00080000:3.0:1769754704.825838:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769754704.825847:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1769754704.825855:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1855720238479232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754704.825901:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1855720238479232:12345-0@lo:400:kworker.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754704.825909:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1769754704.825953:0:53860:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1855720238478336:12345-0@lo:400:kworker.0 Request processed in 15789us (15931us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754704.825967:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2f230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238478336:0@lo:400:kworker.0 00000100:00100000:2.0:1769754704.825973:0:53860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1769754704.825991:0:53860:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238478720 00000100:00100000:2.0:1769754704.825995:0:53860:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238478720 00000100:00100000:2.0:1769754704.826027:0:53860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1769754704.826033:0:53860:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1855720238478720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754704.826067:0:53860:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1855720238478720:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754704.826073:0:53860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1769754704.826327:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238478720:0@lo:400:kworker.0 00000100:00100000:3.0:1769754704.826339:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1855720238479232:0@lo:400:kworker.0 00000040:00080000:3.0:1769754704.999041:0:53890:0:(llog.c:797:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1769754704.999051:0:53890:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769754704.999078:0:53890:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x30:0x0] index 3 count 3 00000040:00080000:3.0:1769754704.999086:0:53890:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1769754705.254953:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1769754705.318907:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1769754705.318932:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238479744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769754705.318996:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754705.319095:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479744 00000100:00100000:3.0:1769754705.319111:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479744 00000100:00100000:3.0:1769754705.319178:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1769754705.319187:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238479744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769754705.319216:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3824304128 avail 3592781824 00000100:00100000:3.0:1769754705.319267:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238479744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754705.319275:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1769754705.319445:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238479744:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1769754706.278806:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754706.346018:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238479872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1769754706.346086:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754706.346183:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238479872 00000100:00100000:3.0:1769754706.346192:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238479872 00000100:00100000:3.0:1769754706.346257:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1769754706.346266:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1855720238479872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769754706.346305:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3776659456 avail 3545137152 00000100:00100000:3.0:1769754706.346349:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1855720238479872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754706.346356:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1769754706.346414:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238479872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769754706.346714:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238480000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1769754706.346742:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1769754706.346805:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769754706.346846:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480000 00000100:00100000:3.0:1769754706.346850:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480000 00000100:00100000:3.0:1769754706.346888:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1769754706.346895:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238480000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1769754706.346905:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3776659456 avail 3545137152 00000100:00100000:3.0:1769754706.346932:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238480000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754706.346939:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1769754706.346988:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769754706.347039:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238480000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1769754706.348391:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238480128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769754706.348446:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754706.352754:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480128 00000100:00100000:2.0:1769754706.352770:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480128 00000100:00100000:2.0:1769754706.354355:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1769754706.354378:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3658:x1855720238480128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1769754706.354431:0:54578:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446068224 avail 1299828736 00000100:00100000:2.0:1769754706.354526:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3658:x1855720238480128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (6079us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754706.354535:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1769754706.354647:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238480128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769754706.862837:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238480256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769754706.862910:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754706.863405:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480256 00000100:00100000:2.0:1769754706.863415:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480256 00000100:00100000:2.0:1769754706.863481:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1769754706.863490:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1855720238480256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1769754706.863525:0:54578:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446244352 avail 1300004864 00000100:00100000:2.0:1769754706.863610:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1855720238480256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754706.863617:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1769754706.863752:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238480256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1769754707.303988:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1769754708.326864:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769754708.804135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754708.804179:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754708.804238:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754708.804277:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754708.804299:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754708.804314:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754708.804351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754708.804465:0:53846:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244864 00000100:00100000:0.0:1769754708.804476:0:53846:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244864 00000100:00100000:0.0:1769754708.804540:0:53846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:0.0:1769754708.804595:0:53846:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2402:x1855720214244864:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754708.804667:0:53846:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2402:x1855720214244864:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 118us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754708.804674:0:53846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:0.0:1769754708.804708:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214245120 00000100:00100000:0.0:1769754708.804712:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214245120 00000100:00100000:0.0:1769754708.804741:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214245632 00000100:00100000:0.0:1769754708.804744:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214245632 00000100:00100000:0.0:1769754708.804757:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214244992 00000100:00100000:0.0:1769754708.804760:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214244992 00000100:00100000:0.0:1769754708.804770:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214245504 00000100:00100000:0.0:1769754708.804772:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214245504 00000100:00100000:0.0:1769754708.804786:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:0.0:1769754708.804792:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af20372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214245120:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754708.804839:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af20372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214245120:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 47us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754708.804845:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:0.0:1769754708.804858:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:0.0:1769754708.804864:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae0b383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2402:x1855720214245632:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754708.804889:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae0b383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2402:x1855720214245632:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754708.804895:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:0.0:1769754708.804915:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:0.0:1769754708.804921:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af30ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+17:2402:x1855720214244992:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754708.804951:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af30ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+17:2402:x1855720214244992:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754708.804958:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:0.0:1769754708.804969:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:0.0:1769754708.804976:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+6:2402:x1855720214245504:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754708.804998:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:906a5562-67c4-4053-950c-2d0d5d87605b+6:2402:x1855720214245504:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754708.805005:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00080000:0.0:1769754708.805037:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1769754708.805042:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769754708.808666:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214245376 00000100:00100000:3.0:1769754708.808679:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214245376 00000100:00100000:3.0:1769754708.808750:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214245248 00000100:00100000:3.0:1769754708.808753:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214245248 00000100:00100000:3.0:1769754708.808788:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:3.0:1769754708.808797:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae0b383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214245376:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1769754708.808877:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae0b383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2402:x1855720214245376:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 81us (4639us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754708.808884:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:3.0:1769754708.808898:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:3.0:1769754708.808903:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af30efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2402:x1855720214245248:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1769754708.808925:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af30efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2402:x1855720214245248:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (4609us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754708.808931:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00080000:0.0:1769754708.810168:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1769754708.810175:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1769754709.352337:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1769754709.432645:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238480384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1769754709.432758:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754709.433237:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480384 00000100:00100000:3.0:1769754709.433263:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480384 00000100:00100000:3.0:1769754709.433362:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1769754709.433374:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1855720238480384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1769754709.433425:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3824304128 avail 3592781824 00000100:00100000:3.0:1769754709.433496:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1855720238480384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754709.433505:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1769754709.433596:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238480384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1769754709.433670:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1769754709.930504:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a13ee795-4761-483e-b23a-f08e958dcf18:3661:1855720238480512:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.930656:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.930731:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238481024:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.930769:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.930797:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1855720238481536:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.930832:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.930870:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1769754709.930877:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1855720238480896:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.930905:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.930925:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1855720238481408:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.930971:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.930988:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1855720238481920:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931010:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931060:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238480640:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931087:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931106:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238481152:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931129:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931148:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1855720238481664:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931169:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931182:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1769754709.931188:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238480768:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931211:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931227:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238481280:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931258:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931279:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1855720238481792:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931299:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754709.931334:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481536 00000100:00100000:0.0:1769754709.931345:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481536 00000100:00100000:0.0:1769754709.931436:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480896 00000100:00100000:0.0:1769754709.931440:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480896 00000100:00100000:0.0:1769754709.931458:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481408 00000100:00100000:0.0:1769754709.931460:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481408 00000100:00100000:0.0:1769754709.931470:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481920 00000100:00100000:0.0:1769754709.931472:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481920 00000100:00100000:0.0:1769754709.931485:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481664 00000100:00100000:0.0:1769754709.931487:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481664 00000100:00100000:0.0:1769754709.931501:0:53855:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481792 00000100:00100000:0.0:1769754709.931510:0:53855:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481792 00000100:00100000:0.0:1769754709.931531:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1769754709.931542:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1855720238481536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931640:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1855720238481536:12345-0@lo:400:kworker.0 Request processed in 98us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.931649:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1769754709.931672:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1769754709.931678:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1855720238480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931705:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1855720238480896:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.931710:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1769754709.931720:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1769754709.931724:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1855720238481408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931746:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1855720238481408:12345-0@lo:400:kworker.0 Request processed in 22us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.931751:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1769754709.931760:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1769754709.931765:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1855720238481920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931790:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1855720238481920:12345-0@lo:400:kworker.0 Request processed in 25us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.931796:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1769754709.931805:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1769754709.931810:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1855720238481664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931852:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1855720238481664:12345-0@lo:400:kworker.0 Request processed in 41us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.931870:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1769754709.931883:0:53855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1769754709.931889:0:53855:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1855720238481792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.931916:0:53855:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1855720238481792:12345-0@lo:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.931922:0:53855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1769754709.931962:0:55326:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481152 00000100:00100000:0.0:1769754709.931966:0:55326:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481152 00000100:00100000:0.0:1769754709.931997:0:55326:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480768 00000100:00100000:0.0:1769754709.932001:0:55326:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480768 00000100:00100000:0.0:1769754709.932013:0:55326:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481280 00000100:00100000:0.0:1769754709.932016:0:55326:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481280 00000100:00100000:0.0:1769754709.932028:0:55326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1769754709.932035:0:55326:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238481152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932063:0:55326:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238481152:12345-0@lo:400:kworker.0 Request processed in 29us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.932069:0:55326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1769754709.932081:0:55326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1769754709.932086:0:55326:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238480768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932112:0:55326:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238480768:12345-0@lo:400:kworker.0 Request processed in 26us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.932117:0:55326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1769754709.932127:0:55326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1769754709.932133:0:55326:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238481280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932161:0:55326:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238481280:12345-0@lo:400:kworker.0 Request processed in 29us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754709.932176:0:55326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1769754709.932195:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1769754709.932200:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1769754709.932203:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1769754709.932205:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1769754709.932281:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238480768:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932294:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238481280:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932305:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1855720238481792:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932316:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238481152:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932327:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1855720238481664:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932378:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1855720238480896:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932390:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1855720238481408:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932400:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1855720238481920:0@lo:400:kworker.0 00000100:00100000:0.0:1769754709.932413:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1855720238481536:0@lo:400:kworker.0 00000100:00100000:2.0:1769754709.932795:0:53848:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480512 00000100:00100000:2.0:1769754709.932803:0:53848:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480512 00000100:00100000:2.0:1769754709.932845:0:53848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1769754709.932852:0:53848:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3661:x1855720238480512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754709.932907:0:53848:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3661:x1855720238480512:12345-0@lo:400:kworker.0 Request processed in 55us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754709.932914:0:53848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1769754709.932950:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238481024 00000100:00100000:2.0:1769754709.932955:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238481024 00000100:00100000:2.0:1769754709.932982:0:54578:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238480640 00000100:00100000:2.0:1769754709.932985:0:54578:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238480640 00000100:00100000:2.0:1769754709.933000:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1769754709.933005:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1855720238481024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754709.933039:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1855720238481024:12345-0@lo:400:kworker.0 Request processed in 34us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754709.933046:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1769754709.933056:0:54578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1769754709.933062:0:54578:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238480640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754709.933095:0:54578:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238480640:12345-0@lo:400:kworker.0 Request processed in 32us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754709.933100:0:54578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1769754709.933195:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238480640:0@lo:400:kworker.0 00000100:00100000:2.0:1769754709.933222:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a13ee795-4761-483e-b23a-f08e958dcf18:3661:1855720238480512:0@lo:400:kworker.0 00000100:00100000:2.0:1769754709.933233:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238481024:0@lo:400:kworker.0 00000001:00080000:2.0:1769754709.937838:0:53834:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738462 is committed 00000020:00080000:2.0:1769754709.937887:0:53834:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ae01d97b40 refcount 2 committed 0 result 0 batchid 30064771699 00000020:00080000:2.0:1769754709.937894:0:53834:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff94af2daac200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ae01d97180 00000020:00080000:2.0:1769754709.937898:0:53834:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff94af2daacd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ae01e62800 00000020:00080000:2.0:1769754709.937950:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771699 committed batchid 30064771698 00000020:00080000:2.0:1769754709.938079:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771698 00000001:00080000:2.0:1769754709.945325:0:55322:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 34359738380 is committed 00000001:00080000:2.0:1769754709.945352:0:55322:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 34359738379 is committed 00000001:02000400:2.0:1769754710.051871:0:57490:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 16: Test detach with different options ========================================================== 01:31:49 (1769754709) 00010000:00010000:0.0:1769754710.374921:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1769754710.439453:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1769754710.439486:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238482048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769754710.439583:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754710.439910:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238482048 00000100:00100000:3.0:1769754710.439920:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238482048 00000100:00100000:3.0:1769754710.439979:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1769754710.439989:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1855720238482048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769754710.440012:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3824304128 avail 3592781824 00000100:00100000:3.0:1769754710.440073:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1855720238482048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754710.440080:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1769754710.440177:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1855720238482048:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1769754711.398858:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754711.462793:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1769754711.462818:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1855720238482176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1769754711.462891:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754711.462984:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238482176 00000100:00100000:3.0:1769754711.462994:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238482176 00000100:00100000:3.0:1769754711.463058:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1769754711.463081:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1855720238482176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769754711.463117:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3776659456 avail 3545137152 00000100:00100000:3.0:1769754711.463180:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1855720238482176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754711.463189:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1769754711.463249:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1855720238482176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1769754711.463605:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1769754711.463605:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238482304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1769754711.463615:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2899b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238482432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769754711.463644:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754711.463645:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754711.463676:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238482432 00000100:00100000:2.0:1769754711.463681:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238482432 00000100:00100000:1.0:1769754711.463686:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238482304 00000100:00100000:1.0:1769754711.463688:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238482304 00000100:00100000:2.0:1769754711.463712:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1769754711.463713:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1769754711.463719:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2899bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1855720238482432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769754711.463719:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af07781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1855720238482304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1769754711.463732:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3776659456 avail 3545137152 00000004:00000024:2.0:1769754711.463744:0:53859:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446068224 avail 1299828736 00000100:00100000:1.0:1769754711.463764:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af07781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1855720238482304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754711.463771:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1769754711.463772:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2899bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1855720238482432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754711.463787:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1769754711.463818:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2899b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238482432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769754711.463983:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238482304:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1769754711.464049:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1769754711.911017:0:54591:0:(llog.c:797:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1769754711.911030:0:54591:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769754711.911052:0:54591:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 2 count 2 00000040:00080000:2.0:1769754711.911060:0:54591:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1769754711.975411:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238482560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1769754711.975489:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754711.975643:0:53860:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238482560 00000100:00100000:0.0:1769754711.975652:0:53860:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238482560 00000100:00100000:0.0:1769754711.975719:0:53860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1769754711.975728:0:53860:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2899b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238482560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1769754711.975776:0:53860:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446244352 avail 1300004864 00000100:00100000:0.0:1769754711.976699:0:53860:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2899b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238482560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 968us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754711.976709:0:53860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1769754711.976943:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238482560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1769754712.086886:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.087813:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214245760 00000100:00100000:0.0:1769754712.087827:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214245760 00000100:00100000:0.0:1769754712.087922:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 180 00000100:00100000:0.0:1769754712.087935:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:52288:x1855720214245760:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1769754712.087970:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.087993:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b84978d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ace8 expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088061:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088079:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088093:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088110:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088117:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088124:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088201:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088211:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088218:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754712.088263:0:53856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1769754712.088269:0:53856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1769754712.088291:0:53856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088305:0:53856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088313:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088319:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088326:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088332:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8aa00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.088337:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088346:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088376:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754712.088379:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.088384:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088391:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b84978d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088408:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088414:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088420:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088425:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8a000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.088428:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088433:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088440:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94af3d404900) 00010000:00010000:0.0:1769754712.088443:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.088446:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.088452:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84978df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1769754712.088917:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1769754712.089166:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b84978d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace8 expref: 10 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.089189:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b600/0x98cc23d8b84978e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace8 expref: 9 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.089198:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94af3d404f00) 00010000:00010000:0.0:1769754712.089200:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1769754712.089204:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae0ab8b600, rc 0) 00000100:00100000:0.0:1769754712.089766:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52288:x1855720214245760:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1833us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.089777:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 180 00000100:00100000:3.0:1769754712.097828:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754712.097931:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214246016 00000100:00100000:1.0:1769754712.097953:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214246016 00000100:00100000:1.0:1769754712.098014:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:1.0:1769754712.098024:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:52288:x1855720214246016:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1769754712.098047:0:55349:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769754712.098071:0:55349:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1e00/0x98cc23d8b84978ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acef expref: -99 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098147:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098164:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098176:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098189:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098218:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098234:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098341:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1600/0x98cc23d8b8497902 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098360:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1600/0x98cc23d8b8497902 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098369:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1600/0x98cc23d8b8497902 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1769754712.098381:0:55349:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1769754712.098477:0:55349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098485:0:55349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098493:0:55349:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098499:0:55349:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af421e0200 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:1.0:1769754712.098505:0:55349:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098513:0:55349:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098539:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94af3d404f00) 00010000:00010000:1.0:1769754712.098542:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769754712.098597:0:55349:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098604:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0200/0x98cc23d8b84978f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098621:0:55349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098627:0:55349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098632:0:55349:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098637:0:55349:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af421e0a00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:1.0:1769754712.098640:0:55349:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098646:0:55349:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098654:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94af132eec00) 00010000:00010000:1.0:1769754712.098656:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769754712.098659:0:55349:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098664:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e0a00/0x98cc23d8b84978fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098971:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1e00/0x98cc23d8b84978ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acef expref: 12 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098988:0:55349:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1600/0x98cc23d8b8497902 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acef expref: 11 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.098995:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94af132ee700) 00010000:00010000:1.0:1769754712.098997:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769754712.099000:0:55349:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af421e1600, rc 0) 00000100:00100000:1.0:1769754712.099067:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52288:x1855720214246016:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1044us (1247us total) trans 34359738463 rc 0/0 00000100:00100000:1.0:1769754712.099075:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:3.0:1769754712.118639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.118783:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214246144 00000100:00100000:0.0:1769754712.118802:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214246144 00000100:00100000:0.0:1769754712.118887:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:0.0:1769754712.118897:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52288:x1855720214246144:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1769754712.119029:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52288:x1855720214246144:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 133us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.119037:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:2.0:1769754712.135602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754712.137150:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214246272 00000100:00100000:1.0:1769754712.137167:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214246272 00000100:00100000:1.0:1769754712.137324:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:1.0:1769754712.137337:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2899ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:52288:x1855720214246272:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1769754712.137468:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2899ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:52288:x1855720214246272:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 134us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754712.137477:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00080000:2.0:1769754712.138848:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1769754712.166799:0:53890:0:(llog.c:797:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1769754712.166809:0:53890:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769754712.166834:0:53890:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x30:0x0] index 3 count 3 00000040:00080000:3.0:1769754712.166842:0:53890:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1769754712.167003:0:53890:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:53890:1855720238482688:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1769754712.167113:0:53890:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11306000 going to sleep for 11 seconds 00000100:00100000:3.0:1769754712.179919:0:53890:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:53890:1855720238482688:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1769754712.190266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.190819:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214246400 00000100:00100000:0.0:1769754712.190831:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214246400 00000100:00100000:0.0:1769754712.190961:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:0.0:1769754712.190972:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52297:x1855720214246400:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1769754712.191008:0:53856:0:(mdt_handler.c:7932:mdt_fid2path()) path get [0x200003ab1:0xa:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1769754712.191161:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52297:x1855720214246400:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 190us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.191185:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:2.0:1769754712.194531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.194646:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214246656 00000100:00100000:0.0:1769754712.194658:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214246656 00000100:00100000:0.0:1769754712.194723:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:0.0:1769754712.194733:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2899b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+11:52297:x1855720214246656:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1769754712.194756:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.194908:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b8497910 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acf6 expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.195184:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b8497917 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.195203:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b8497917 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.195216:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b8497917 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754712.195237:0:53856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 1024 00010000:00010000:0.0:1769754712.195534:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b8497910 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acf6 expref: 14 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.195582:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8aa00/0x98cc23d8b8497917 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acf6 expref: 13 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.195592:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff94ae0149f300) 00010000:00010000:0.0:1769754712.195595:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769754712.195598:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae0ab8aa00, rc 0) 00000100:00100000:0.0:1769754712.195687:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2899b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52297:x1855720214246656:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 954us (1165us total) trans 34359738464 rc 0/0 00000100:00100000:0.0:1769754712.195695:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:3.0:1769754712.202216:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.202326:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214246784 00000100:00100000:0.0:1769754712.202344:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214246784 00000100:00100000:0.0:1769754712.202433:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1769754712.202445:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52297:x1855720214246784:12345-192.168.202.41@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1769754712.202634:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52297:x1855720214246784:12345-192.168.202.41@tcp:49:lhsmtool_posix.0 Request processed in 190us (436us total) trans 0 rc -61/-61 00000100:00100000:0.0:1769754712.202644:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:3.0:1769754712.206702:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.206813:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214247040 00000100:00100000:0.0:1769754712.206831:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214247040 00000100:00100000:0.0:1769754712.206910:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:0.0:1769754712.206922:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52297:x1855720214247040:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000040:00080000:3.0:1769754712.207734:0:53890:0:(llog.c:797:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1769754712.207740:0:53890:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769754712.207758:0:53890:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x30:0x0] index 3 count 3 00000040:00080000:3.0:1769754712.207763:0:53890:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1769754712.207886:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52297:x1855720214247040:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 965us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.207897:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:2.0:1769754712.211392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754712.211626:0:53858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214247296 00000100:00100000:3.0:1769754712.211637:0:53858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214247296 00000100:00100000:3.0:1769754712.211699:0:53858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1769754712.211709:0:53858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3c966450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+13:52297:x1855720214247296:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1769754712.211966:0:53858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3c966450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:52297:x1855720214247296:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 257us (583us total) trans 34359738465 rc 0/0 00000100:00100000:3.0:1769754712.211975:0:53858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1769754712.252544:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.252794:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214247552 00000100:00100000:0.0:1769754712.252809:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214247552 00000100:00100000:0.0:1769754712.252892:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:0.0:1769754712.252904:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+14:52303:x1855720214247552:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1769754712.252936:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.252940:0:53856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1769754712.252980:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7200/0x98cc23d8b84977a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ac8d expref: 14 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.253444:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754712.253452:0:53856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1769754712.253472:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b8497925 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4acfd expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.253692:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.253712:0:53856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 5 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.253721:0:53856:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.253768:0:53856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 5 pid: 53855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.253785:0:53856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 5 pid: 53855 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.254326:0:53856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28861c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:53856:1855720238482816:192.168.202.41@tcp:104: 00000100:00100000:0.0:1769754712.254837:0:53856:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae03250840 going to sleep for 11 seconds 00000100:00100000:0.0:1769754712.258856:0:53856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28861c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:53856:1855720238482816:192.168.202.41@tcp:104: 00010000:00010000:0.0:1769754712.258899:0:53856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754712.260132:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754712.260400:0:53841:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214247680 00000100:00100000:1.0:1769754712.260411:0:53841:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214247680 00010000:00010000:1.0:1769754712.260496:0:53841:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 6 pid: 53855 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1769754712.260543:0:53841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1769754712.260591:0:53841:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:906a5562-67c4-4053-950c-2d0d5d87605b+6:2403:x1855720214247680:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769754712.260630:0:53841:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769754712.260639:0:53841:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 6 pid: 53855 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.260654:0:53841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 6 pid: 53855 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.260683:0:53841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84978ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ace1 expref: 6 pid: 53855 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.260706:0:53841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:1.0:1769754712.260711:0:53841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.260723:0:53841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.260733:0:53841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.260771:0:53841:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769754712.260840:0:53841:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:906a5562-67c4-4053-950c-2d0d5d87605b+5:2403:x1855720214247680:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 252us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754712.260851:0:53841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00010000:00010000:0.0:1769754712.260997:0:53856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261014:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261061:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261073:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261082:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1769754712.261635:0:53856:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xe4:0x0], index 1: 0 00010000:00010000:0.0:1769754712.261870:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261885:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261895:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261945:0:53856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261953:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261960:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261969:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.261988:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8a600 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.261995:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262003:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262016:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754712.262020:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.262025:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262032:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b849792c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1769754712.262046:0:53856:0:(mdt_handler.c:4458:mdt_save_lock()) ### save lock request 00000000f5d46963 reply state 000000009e8210a2 transno 34359738466 ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262058:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262065:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff94af3d404900) 00010000:00010000:0.0:1769754712.262067:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769754712.262071:0:53856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769754712.262113:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b8497925 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 16 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262129:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 15 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.262148:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:0.0:1769754712.262150:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769754712.262153:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00030e00, rc 0) 00000100:00100000:0.0:1769754712.262211:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52303:x1855720214247552:12345-192.168.202.41@tcp:101:bash.0 Request processed in 9309us (9684us total) trans 34359738466 rc 0/0 00000100:00100000:0.0:1769754712.262221:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00080000:2.0:1769754712.262827:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769754712.267685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754712.267778:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214247808 00000100:00100000:3.0:1769754712.267791:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214247808 00000100:00100000:3.0:1769754712.267877:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:3.0:1769754712.267889:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2404:x1855720214247808:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1769754712.267931:0:56217:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769754712.267959:0:56217:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad04 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1769754712.268003:0:56217:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769754712.268036:0:56217:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754712.268039:0:56217:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754712.268051:0:56217:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 6 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.268076:0:56217:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 6 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.268093:0:56217:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af295a6800, rc 0) 00000100:00100000:3.0:1769754712.268177:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2404:x1855720214247808:12345-192.168.202.41@tcp:101:bash.0 Request processed in 290us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754712.268186:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00080000:2.0:1769754712.268394:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769754712.271988:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.272101:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214247936 00000100:00100000:0.0:1769754712.272115:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214247936 00000100:00100000:0.0:1769754712.272200:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1769754712.272212:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:52303:x1855720214247936:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1769754712.272246:0:55328:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.272278:0:55328:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad0b expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.272328:0:55328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 7 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.272339:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769754712.272342:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769754712.272358:0:55328:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 7 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.272409:0:55328:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 7 pid: 56217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.272453:0:55328:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 7 pid: 56217 timeout: 2167 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.272471:0:55328:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28861c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:55328:1855720238482944:192.168.202.41@tcp:104: 00000100:00100000:0.0:1769754712.272782:0:55328:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae03250b40 going to sleep for 11 seconds 00000100:00100000:2.0:1769754712.277075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754712.277626:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214248064 00000100:00100000:3.0:1769754712.277642:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214248064 00010000:00010000:3.0:1769754712.277702:0:53840:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 8 pid: 56217 timeout: 2167 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754712.277760:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:3.0:1769754712.277771:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+8:2402:x1855720214248064:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769754712.277791:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769754712.277822:0:53840:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 8 pid: 56217 timeout: 2167 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.277861:0:53840:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 8 pid: 56217 timeout: 2167 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.277898:0:53840:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754712.277901:0:53840:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754712.277913:0:53840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.277925:0:53840:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.277982:0:53840:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 8 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754712.278008:0:53840:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:53840:1855720238483072:192.168.202.41@tcp:105: 00000100:00100000:3.0:1769754712.278303:0:53840:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11306a80 going to sleep for 11 seconds 00010000:00010000:0.0:1769754712.278886:0:55328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ecde5c6/0x98cc23d8b8497948 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad04 expref: 8 pid: 56217 timeout: 2167 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.278909:0:55328:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28861c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:55328:1855720238482944:192.168.202.41@tcp:104: 00010000:00010000:0.0:1769754712.278944:0:55328:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 7 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.278957:0:55328:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00031000, rc 0) 00000100:00100000:0.0:1769754712.279141:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:52303:x1855720214247936:12345-192.168.202.41@tcp:101:bash.0 Request processed in 6930us (7166us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.279152:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1769754712.284274:0:53840:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:53840:1855720238483072:192.168.202.41@tcp:105: 00010000:00010000:3.0:1769754712.284323:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769754712.284407:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2402:x1855720214248064:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 6635us (7351us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754712.284421:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1769754712.286024:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.286115:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214248320 00000100:00100000:0.0:1769754712.286128:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214248320 00000100:00100000:0.0:1769754712.286201:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:0.0:1769754712.286214:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+16:52303:x1855720214248320:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:0.0:1769754712.286692:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+17:52303:x1855720214248320:12345-192.168.202.41@tcp:35:bash.0 Request processed in 478us (675us total) trans 34359738467 rc 0/0 00000100:00100000:0.0:1769754712.286701:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1769754712.320889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.321055:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214248448 00000100:00100000:0.0:1769754712.321070:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214248448 00000100:00100000:0.0:1769754712.321150:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:0.0:1769754712.321161:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+17:52306:x1855720214248448:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1769754712.321194:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.321222:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad12 expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.321322:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b849795d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.321340:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b849795d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.321367:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b849795d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754712.321426:0:53856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1769754712.321431:0:53856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1769754712.321456:0:53856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b849795d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.321487:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad12 expref: 19 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.321511:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030a00/0x98cc23d8b849795d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad12 expref: 18 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.321520:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754712.321524:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1769754712.321612:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00030a00, rc 0) 00000100:00100000:0.0:1769754712.321706:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+18:52306:x1855720214248448:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 545us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.321716:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 188 00010000:00010000:0.0:1769754712.424495:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769754712.587627:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754712.587729:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214248704 00000100:00100000:1.0:1769754712.587741:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214248704 00000100:00100000:1.0:1769754712.587816:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:1.0:1769754712.587823:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2899a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+18:52322:x1855720214248704:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1769754712.587848:0:55349:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769754712.587873:0:55349:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b8497964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad19 expref: -99 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.588042:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1000/0x98cc23d8b849796b lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.588056:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1000/0x98cc23d8b849796b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.588066:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1000/0x98cc23d8b849796b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1769754712.588078:0:55349:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xd:0x0]: returning size 11 00010000:00010000:1.0:1769754712.588214:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1a00/0x98cc23d8b8497964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad19 expref: 21 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.588247:0:55349:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1000/0x98cc23d8b849796b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad19 expref: 20 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.588262:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:1.0:1769754712.588265:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769754712.588269:0:55349:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af421e1000, rc 0) 00000100:00100000:1.0:1769754712.588409:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2899a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+20:52322:x1855720214248704:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 583us (794us total) trans 34359738468 rc 0/0 00000100:00100000:1.0:1769754712.588418:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:3.0:1769754712.595091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754712.595149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.595260:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249088 00000100:00100000:0.0:1769754712.595276:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249088 00000100:00100000:0.0:1769754712.595365:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:0.0:1769754712.595378:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+20:52322:x1855720214249088:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1769754712.595415:0:55349:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.595447:0:55349:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497979 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad20 expref: -99 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.595679:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b8497980 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.595700:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b8497980 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.595716:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b8497980 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754712.595735:0:55349:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xd:0x0]: returning size 11 00010000:00010000:0.0:1769754712.595881:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030200/0x98cc23d8b8497979 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad20 expref: 23 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.595906:0:55349:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b8497980 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad20 expref: 22 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.595915:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:0.0:1769754712.595925:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1769754712.595929:0:55349:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae0ab8ba00, rc 0) 00000100:00100000:2.0:1769754712.596055:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214248832 00000100:00100000:2.0:1769754712.596061:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214248832 00000100:00100000:2.0:1769754712.596107:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1769754712.596114:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94ae03c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+23:2403:x1855720214248832:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769754712.596126:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769754712.596145:0:53840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af421e1000/0x98cc23d8b849796b lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad19 expref: 23 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.596165:0:53840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:2.0:1769754712.596168:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769754712.597660:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+22:52322:x1855720214249088:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2270us (2496us total) trans 34359738469 rc 0/0 00000100:00100000:0.0:1769754712.597677:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:2.0:1769754712.597875:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94ae03c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+21:2403:x1855720214248832:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1758us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754712.597884:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1769754712.606120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.606768:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249216 00000100:00100000:0.0:1769754712.606784:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249216 00000100:00100000:0.0:1769754712.606866:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1769754712.606878:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2405:x1855720214249216:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:0.0:1769754712.606938:0:55328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.606964:0:55328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 6 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.606975:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1769754712.606978:0:55328:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1769754712.607202:0:55328:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.607262:0:55328:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 6 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.607279:0:55328:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 6 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.607299:0:55328:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28861c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:55328:1855720238483200:192.168.202.41@tcp:104: 00000100:00100000:0.0:1769754712.609880:0:55328:0:(client.c:2690:ptlrpc_set_wait()) set ffff94ae03250a80 going to sleep for 11 seconds 00000100:00100000:1.0:1769754712.613916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754712.614106:0:55332:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249344 00000100:00100000:2.0:1769754712.614120:0:55332:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249344 00002000:00100000:2.0:1769754712.614188:0:55332:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xe4:0x0] (0->10) req@ffff94af3fc29c00 x1855720214249344/t0(0) o4->0c0f1214-0730-446f-804c-1ee9dc41ddf3@192.168.202.41@tcp:748/0 lens 504/0 e 0 to 0 dl 1769754723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769754712.614201:0:55332:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94af3fc29c00 with x1855720214249344 ext(0->10) 00010000:00010000:2.0:1769754712.614214:0:55332:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 7 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.614248:0:55332:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 7 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1769754712.614258:0:55332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94af3fc29c00 00000100:00100000:2.0:1769754712.614303:0:55332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1769754712.614315:0:55332:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2402:x1855720214249344:12345-192.168.202.41@tcp:4:lfs.0 00000100:00100000:2.0:1769754712.615706:0:55332:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:2402:x1855720214249344:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 1381us (1795us total) trans 34359738381 rc 0/0 00000100:00100000:2.0:1769754712.615722:0:55332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00002000:00100000:2.0:1769754712.615735:0:55332:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xe4:0x0] (0->10) req@ffff94af3fc29c00 x1855720214249344/t34359738381(0) o4->0c0f1214-0730-446f-804c-1ee9dc41ddf3@192.168.202.41@tcp:748/0 lens 504/448 e 0 to 0 dl 1769754723 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769754712.615764:0:55332:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94af3fc29c00 with x1855720214249344 ext(0->10) 00010000:00010000:2.0:1769754712.615776:0:55332:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 9 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.615795:0:55332:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 9 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1769754712.615804:0:55332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94af3fc29c00 00000100:00100000:2.0:1769754712.622770:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754712.623093:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249472 00000100:00100000:3.0:1769754712.623109:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249472 00010000:00010000:3.0:1769754712.623170:0:53840:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 9 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754712.623239:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1769754712.623252:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:2402:x1855720214249472:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769754712.623277:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1769754712.623305:0:53840:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xe4:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:3.0:1769754712.623307:0:53840:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xe4:0x0] updating lvb mtime from disk: 0 -> 1769754713 00002000:00010000:3.0:1769754712.623310:0:53840:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xe4:0x0] updating lvb atime from disk: 0 -> 1769754713 00002000:00010000:3.0:1769754712.623312:0:53840:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xe4:0x0] updating lvb ctime from disk: 0 -> 1769754713 00002000:00010000:3.0:1769754712.623315:0:53840:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xe4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1769754712.623322:0:53840:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 9 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.623339:0:53840:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 9 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.623745:0:53840:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754712.623747:0:53840:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754712.623756:0:53840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.623771:0:53840:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.623800:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769754712.623892:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+9:2402:x1855720214249472:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 641us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754712.623902:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00010000:00010000:0.0:1769754712.624529:0:55328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4fb83a4/0x98cc23d8b849794f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad0b expref: 8 pid: 55328 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.624583:0:55328:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28861c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:55328:1855720238483200:192.168.202.41@tcp:104: 00010000:00010000:0.0:1769754712.624614:0:55328:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624809:0:55328:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624821:0:55328:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624861:0:55328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624870:0:55328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624877:0:55328:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624885:0:55328:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8a000 already unused, calling callback (ffffffffc0ed6360) 00010000:00010000:1.0:1769754712.624890:0:55328:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624900:0:55328:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624918:0:55328:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.624927:0:55328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f068046d/0x98cc23d8b849798e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1769754712.625047:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2405:x1855720214249216:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 18170us (18941us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754712.625057:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1769754712.636457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754712.636770:0:53858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249728 00000100:00100000:3.0:1769754712.636784:0:53858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249728 00000100:00100000:3.0:1769754712.636862:0:53858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:3.0:1769754712.636874:0:53858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+21:52322:x1855720214249728:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:3.0:1769754712.636975:0:53858:0:(mdt_open.c:1996:mdt_hsm_release()) ### [0x200003ab1:0xd:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b8497980 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad20 expref: 21 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1769754712.637276:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738470 00000001:00080000:3.0:1769754712.637313:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738471 00000001:00080000:3.0:1769754712.638388:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738472 00010000:00010000:3.0:1769754712.638455:0:53858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.638480:0:53858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 25 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.638490:0:53858:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.638545:0:53858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 25 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.640420:0:53858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 25 pid: 53856 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1769754712.640448:0:53858:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:53858:1855720238483328:192.168.202.41@tcp:104: 00000100:00100000:2.0:1769754712.640860:0:53858:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11306a80 going to sleep for 11 seconds 00000100:00100000:3.0:1769754712.658500:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754712.658678:0:53858:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:53858:1855720238483328:192.168.202.41@tcp:104: 00010000:00010000:2.0:1769754712.658727:0:53858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.667810:0:53840:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249856 00000100:00100000:0.0:1769754712.667835:0:53840:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249856 00010000:00010000:2.0:1769754712.668132:0:53840:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 26 pid: 53856 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1769754712.668193:0:53840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:2.0:1769754712.668204:0:53840:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+26:2403:x1855720214249856:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769754712.668233:0:53840:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769754712.668243:0:53840:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 26 pid: 53856 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.668262:0:53840:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 26 pid: 53856 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.668311:0:53840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b849793a lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4acfd expref: 26 pid: 53856 timeout: 2167 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.668334:0:53840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:2.0:1769754712.668341:0:53840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.668363:0:53840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.668371:0:53840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.668414:0:53840:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769754712.668502:0:53840:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+25:2403:x1855720214249856:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 299us (10018us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754712.668511:0:53840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00010000:00010000:3.0:1769754712.669622:0:53858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754712.669639:0:53858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1769754712.669804:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738473 00000001:00080000:3.0:1769754712.669977:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738474 00000100:00100000:3.0:1769754712.670117:0:53858:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:53858:1855720238483456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1769754712.670202:0:53858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754712.670263:0:53858:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11306000 going to sleep for 11 seconds 00000100:00100000:0.0:1769754712.670593:0:53860:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238483456 00000100:00100000:0.0:1769754712.670603:0:53860:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238483456 00000100:00100000:0.0:1769754712.670671:0:53860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1769754712.670683:0:53860:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:53858:x1855720238483456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1769754712.670833:0:53860:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:53858:x1855720238483456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.670842:0:53860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1769754712.671647:0:53858:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:53858:1855720238483456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1769754712.671836:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738475 00000100:00100000:2.0:1769754712.671921:0:53858:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28999180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:53858:1855720238483584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1769754712.672444:0:53858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754712.672482:0:53858:0:(client.c:2690:ptlrpc_set_wait()) set ffff94af11306300 going to sleep for 11 seconds 00000100:00100000:3.0:1769754712.673153:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238483584 00000100:00100000:3.0:1769754712.673163:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238483584 00000100:00100000:3.0:1769754712.673304:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1769754712.673317:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:53858:x1855720238483584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1769754712.673576:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:53858:x1855720238483584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 262us (1132us total) trans 34359738382 rc 0/0 00000100:00100000:3.0:1769754712.673585:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1769754712.673694:0:53858:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28999180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:53858:1855720238483584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1769754712.673773:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738476 00010000:00010000:1.0:1769754712.673826:0:53858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.673838:0:53858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.673846:0:53858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.673853:0:53858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a7000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:1.0:1769754712.673858:0:53858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.673867:0:53858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.673885:0:53858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:1.0:1769754712.673889:0:53858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1769754712.673894:0:53858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754712.673900:0:53858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af295a7000/0x98cc23d8b8497995 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1769754712.674075:0:53858:0:(mdd_object.c:3993:mdd_close()) Object [0x200003ab1:0xe:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1769754712.674154:0:53858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].4, 64 off8448 00000004:00080000:1.0:1769754712.674167:0:53858:0:(osp_sync.c:1841:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2067611617130ns, next at 2068611614297ns, rc = 0 00000001:00080000:1.0:1769754712.674174:0:53858:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 34359738477 00010000:00010000:1.0:1769754712.674319:0:53858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94af3d404c00) 00010000:00010000:1.0:1769754712.674323:0:53858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1769754712.674330:0:53858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b8497980 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad20 expref: 29 pid: 55349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1769754712.674467:0:53858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+28:52322:x1855720214249728:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 37595us (38028us total) trans 34359738478 rc 0/0 00000100:00100000:1.0:1769754712.674479:0:53858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000020:00080000:1.0:1769754712.674484:0:53858:0:(tgt_main.c:782:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1769754712.682830:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754712.684441:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214249984 00000100:00100000:2.0:1769754712.684461:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214249984 00000100:00100000:2.0:1769754712.684697:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:2.0:1769754712.684711:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+28:52322:x1855720214249984:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1769754712.684764:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769754712.684797:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05200/0x98cc23d8b849799c lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad27 expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.684870:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05200/0x98cc23d8b849799c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad27 expref: 29 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.684888:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f05200/0x98cc23d8b849799c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad27 expref: 29 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754712.684906:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94ae017cdf00) 00010000:00010000:2.0:1769754712.684909:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1769754712.684913:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae02f05200, rc 0) 00000100:00100000:2.0:1769754712.685057:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+29:52322:x1855720214249984:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 349us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754712.685065:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:1.0:1769754712.690700:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754712.691143:0:53858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214250240 00000100:00100000:2.0:1769754712.691158:0:53858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214250240 00000100:00100000:2.0:1769754712.691236:0:53858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1769754712.691248:0:53858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+29:52322:x1855720214250240:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1769754712.691638:0:53858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c0f1214-0730-446f-804c-1ee9dc41ddf3+30:52322:x1855720214250240:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 390us (952us total) trans 34359738479 rc 0/0 00000100:00100000:2.0:1769754712.691647:0:53858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1769754712.820196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754712.821184:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214250368 00000100:00100000:2.0:1769754712.821203:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214250368 00000100:00100000:2.0:1769754712.821305:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:2.0:1769754712.821317:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+30:52332:x1855720214250368:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:0.0:1769754712.825509:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825666:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825685:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825711:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825740:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825748:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825866:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825875:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.825881:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1769754712.828813:0:53856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828860:0:53856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828870:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828879:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828888:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828895:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8a600 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.828901:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828937:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828972:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754712.828976:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.828989:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.828998:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829023:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829043:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829049:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829056:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8ba00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.829059:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829066:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829075:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff94af3d404900) 00010000:00010000:0.0:1769754712.829078:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.829082:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829100:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829114:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829120:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829126:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829131:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8a000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.829135:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829141:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829150:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94ae017cdf00) 00010000:00010000:0.0:1769754712.829153:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.829156:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.829163:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b1 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.829309:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+30:52332:x1855720214250368:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 7988us (9126us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.829322:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1769754712.882454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.882668:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214250624 00000100:00100000:0.0:1769754712.882683:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214250624 00000100:00100000:0.0:1769754712.882774:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:0.0:1769754712.882786:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+30:52335:x1855720214250624:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1769754712.882817:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769754712.882845:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad2e expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.882944:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.882963:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.882979:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.882991:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.882998:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883005:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883164:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84979cd lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883174:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84979cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883204:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84979cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1769754712.883217:0:53856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xd:0x0]: returning size 11 00010000:00010000:0.0:1769754712.883324:0:53856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883333:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883339:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883347:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883353:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8ba00 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.883357:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883365:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883415:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ae017cdd00) 00010000:00010000:0.0:1769754712.883418:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.883423:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883429:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8ba00/0x98cc23d8b84979bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883445:0:53856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883457:0:53856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883464:0:53856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883468:0:53856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8a600 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.883472:0:53856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883479:0:53856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883506:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff94af3d404900) 00010000:00010000:0.0:1769754712.883509:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769754712.883512:0:53856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883518:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a600/0x98cc23d8b84979c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883656:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8a000/0x98cc23d8b84979b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad2e expref: 33 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883672:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00030e00/0x98cc23d8b84979cd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad2e expref: 32 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.883680:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94ae017cdf00) 00010000:00010000:0.0:1769754712.883682:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769754712.883690:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94af00030e00, rc 0) 00000100:00100000:0.0:1769754712.883801:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+32:52335:x1855720214250624:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1016us (1364us total) trans 34359738480 rc 0/0 00000100:00100000:0.0:1769754712.883811:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:1.0:1769754712.891014:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.891186:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214250752 00000100:00100000:0.0:1769754712.891204:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214250752 00000100:00100000:0.0:1769754712.891316:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:0.0:1769754712.891332:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+32:52335:x1855720214250752:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1769754712.891455:0:55349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891479:0:55349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891492:0:55349:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891538:0:55349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891586:0:55349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891595:0:55349:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891603:0:55349:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af00031000 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:0.0:1769754712.891609:0:55349:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891618:0:55349:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891655:0:55349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94ae017cdf00) 00010000:00010000:0.0:1769754712.891659:0:55349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1769754712.891666:0:55349:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754712.891673:0:55349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94af00031000/0x98cc23d8b84979db lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 55349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1769754712.891777:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+32:52335:x1855720214250752:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 447us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754712.891786:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1769754712.895407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754712.896428:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214251008 00000100:00100000:0.0:1769754712.896445:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214251008 00000100:00100000:1.0:1769754712.896687:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:1.0:1769754712.896702:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+32:52335:x1855720214251008:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1769754712.897533:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+33:52335:x1855720214251008:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 828us (2135us total) trans 34359738481 rc 0/0 00000100:00100000:1.0:1769754712.897544:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000040:00080000:2.0:1769754712.936897:0:54591:0:(llog.c:797:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1769754712.936910:0:54591:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769754712.936962:0:54591:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 2 count 2 00000040:00080000:2.0:1769754712.936974:0:54591:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1769754713.029955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1769754713.030098:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214251264 00000100:00100000:2.0:1769754713.030112:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214251264 00000100:00100000:2.0:1769754713.030198:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:2.0:1769754713.030209:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+33:52345:x1855720214251264:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1769754713.030254:0:53856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769754713.030286:0:53856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04000/0x98cc23d8b84979e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa4e95dd6cff4ad35 expref: -99 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754713.030462:0:53856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04800/0x98cc23d8b84979e9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754713.030481:0:53856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04800/0x98cc23d8b84979e9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754713.030495:0:53856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04800/0x98cc23d8b84979e9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1769754713.030509:0:53856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200003ab1:0xd:0x0]: returning size 11 00010000:00010000:2.0:1769754713.030716:0:53856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04000/0x98cc23d8b84979e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad35 expref: 36 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754713.030737:0:53856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04800/0x98cc23d8b84979e9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad35 expref: 35 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754713.030747:0:53856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94ae017cdf00) 00010000:00010000:2.0:1769754713.030770:0:53856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769754713.030776:0:53856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ae02f04800, rc 0) 00000100:00100000:2.0:1769754713.030860:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+35:52345:x1855720214251264:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 652us (921us total) trans 34359738482 rc 0/0 00000100:00100000:2.0:1769754713.030868:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:3.0:1769754713.034750:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1769754713.036866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1769754713.041971:0:53857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214251520 00000100:00100000:1.0:1769754713.042002:0:53857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214251520 00000100:00100000:1.0:1769754713.042120:0:53857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1769754713.042133:0:53857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3c964450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+35:52345:x1855720214251520:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1769754713.042521:0:53857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3c964450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+36:52345:x1855720214251520:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 389us (7783us total) trans 34359738483 rc 0/0 00000100:00100000:1.0:1769754713.042531:0:53857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1769754713.050010:0:53841:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214251648 00000100:00100000:0.0:1769754713.050041:0:53841:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214251648 00000100:00100000:0.0:1769754713.050169:0:53841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1769754713.050182:0:53841:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+36:2405:x1855720214251648:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769754713.050204:0:53841:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769754713.050247:0:53841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae02f04800/0x98cc23d8b84979e9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xa4e95dd6cff4ad35 expref: 36 pid: 53856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1769754713.050275:0:53841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff94ae017cdf00) 00010000:00010000:0.0:1769754713.050281:0:53841:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769754713.050375:0:53841:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c0f1214-0730-446f-804c-1ee9dc41ddf3+35:2405:x1855720214251648:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 196us (13524us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.050384:0:53841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00010000:00010000:2.0:1769754713.447269:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754713.927084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927195:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927325:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1769754713.927371:0:53846:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214251776 00000100:00100000:0.0:1769754713.927384:0:53846:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214251776 00000100:00100000:0.0:1769754713.927453:0:53846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1769754713.927464:0:53846:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2404:x1855720214251776:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.927623:0:53846:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87a81763-d7ab-446c-85c3-5b61f9725c28+12:2404:x1855720214251776:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 161us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.927632:0:53846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1769754713.927675:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214251904 00000100:00100000:0.0:1769754713.927679:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214251904 00000100:00100000:0.0:1769754713.927703:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214252416 00000100:00100000:0.0:1769754713.927706:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214252416 00000100:00100000:0.0:1769754713.927718:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214252032 00000100:00100000:0.0:1769754713.927720:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214252032 00000100:00100000:0.0:1769754713.927730:0:53854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214252544 00000100:00100000:0.0:1769754713.927732:0:53854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214252544 00000100:00100000:0.0:1769754713.927757:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:0.0:1769754713.927764:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+35:2404:x1855720214251904:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.927802:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+35:2404:x1855720214251904:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.927810:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:0.0:1769754713.927822:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:0.0:1769754713.927828:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:906a5562-67c4-4053-950c-2d0d5d87605b+5:2404:x1855720214252416:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.927864:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:906a5562-67c4-4053-950c-2d0d5d87605b+5:2404:x1855720214252416:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.927871:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:0.0:1769754713.927882:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1769754713.927889:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2404:x1855720214252032:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.927916:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c0f1214-0730-446f-804c-1ee9dc41ddf3+5:2404:x1855720214252032:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.927922:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1769754713.927932:0:53854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:0.0:1769754713.927939:0:53854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:906a5562-67c4-4053-950c-2d0d5d87605b+5:2404:x1855720214252544:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.927966:0:53854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:906a5562-67c4-4053-950c-2d0d5d87605b+5:2404:x1855720214252544:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.927973:0:53854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:0.0:1769754713.927994:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214252160 00000100:00100000:0.0:1769754713.927998:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214252160 00000100:00100000:0.0:1769754713.928023:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720214252288 00000100:00100000:0.0:1769754713.928026:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720214252288 00000100:00100000:0.0:1769754713.928044:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:0.0:1769754713.928051:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2404:x1855720214252160:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.928079:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+6:2404:x1855720214252160:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.928085:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:0.0:1769754713.928096:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:0.0:1769754713.928102:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2404:x1855720214252288:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1769754713.928136:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c0f1214-0730-446f-804c-1ee9dc41ddf3+7:2404:x1855720214252288:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754713.928142:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00080000:2.0:1769754713.928446:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1769754713.928453:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1769754714.278795:0:53890:0:(llog.c:797:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1769754714.278805:0:53890:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769754714.278829:0:53890:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x30:0x0] index 3 count 3 00000040:00080000:3.0:1769754714.278840:0:53890:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1769754714.474950:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769754714.542364:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238483712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1769754714.542441:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754714.544049:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238483712 00000100:00100000:3.0:1769754714.544065:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238483712 00000100:00100000:3.0:1769754714.544164:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1769754714.544178:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af28998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238483712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1769754714.544229:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3824304128 avail 3592781824 00000100:00080000:1.0:1769754714.544506:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769754714.547797:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af28998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1855720238483712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3613us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754714.547812:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1769754714.548254:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738380 gen 2 00000004:00080000:2.0:1769754714.548262:0:3658:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 34359738380 committed transno 34359738380 00000100:00100000:2.0:1769754714.548298:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1855720238483712:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1769754714.903490:0:57539:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_16: @@@@@@ FAIL: /mnt/lustre/f16.sanity-pcc expected pcc state: none, but got: readwrite 00000100:00100000:0.0:1769754715.047578:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238484096:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047642:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754715.047670:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238484608:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047687:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754715.047700:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1855720238485120:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047719:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754715.047738:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1769754715.047743:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238483968:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047761:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754715.047775:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238484480:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047790:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754715.047802:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1855720238484992:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047817:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754715.047843:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484096 00000100:00100000:0.0:1769754715.047850:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484096 00000100:00100000:0.0:1769754715.047893:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484608 00000100:00100000:0.0:1769754715.047895:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484608 00000100:00100000:0.0:1769754715.047908:0:55328:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484480 00000100:00100000:0.0:1769754715.047910:0:55328:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484480 00000100:00100000:0.0:1769754715.047923:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1769754715.047930:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1855720238484096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.047972:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1855720238484096:12345-0@lo:400:kworker.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754715.047988:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1769754715.048005:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1769754715.048011:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238484608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048035:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238484608:12345-0@lo:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754715.048041:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1769754715.048049:0:55328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1769754715.048054:0:55328:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238484480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048075:0:55328:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1855720238484480:12345-0@lo:400:kworker.0 Request processed in 20us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754715.048080:0:55328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1769754715.048099:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238483968 00000100:00100000:0.0:1769754715.048101:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238483968 00000100:00100000:0.0:1769754715.048123:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1769754715.048128:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238483968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048153:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1855720238483968:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754715.048159:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1769754715.048177:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485120 00000100:00100000:0.0:1769754715.048180:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485120 00000100:00100000:0.0:1769754715.048213:0:53856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484992 00000100:00100000:0.0:1769754715.048216:0:53856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484992 00000100:00100000:0.0:1769754715.048232:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1769754715.048238:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3432ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1855720238485120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048263:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3432ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1855720238485120:12345-0@lo:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754715.048277:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1769754715.048288:0:53856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1769754715.048293:0:53856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2d209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1855720238484992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048314:0:53856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2d209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1855720238484992:12345-0@lo:400:kworker.0 Request processed in 21us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754715.048320:0:53856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1769754715.048366:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238483968:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048376:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238484480:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048383:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1855720238484992:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048392:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238484096:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048399:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238484608:0@lo:400:kworker.0 00000100:00100000:0.0:1769754715.048406:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1855720238485120:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052303:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a13ee795-4761-483e-b23a-f08e958dcf18:3659:1855720238483840:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052377:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754715.052439:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1855720238484352:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052470:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754715.052494:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1855720238484864:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052517:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754715.052543:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1769754715.052564:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af28862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1855720238484224:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052586:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754715.052604:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1855720238484736:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052623:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754715.052640:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3432ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1855720238485248:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052663:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754715.052697:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484864 00000100:00100000:1.0:1769754715.052705:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484864 00000100:00100000:1.0:1769754715.052752:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484224 00000100:00100000:1.0:1769754715.052755:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484224 00000100:00100000:1.0:1769754715.052767:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484736 00000100:00100000:1.0:1769754715.052769:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484736 00000100:00100000:1.0:1769754715.052777:0:55349:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485248 00000100:00100000:1.0:1769754715.052779:0:55349:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485248 00000100:00100000:1.0:1769754715.052807:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1769754715.052815:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1855720238484864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052868:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1855720238484864:12345-0@lo:400:kworker.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754715.052875:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1769754715.052890:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1769754715.052895:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1855720238484224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052922:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1855720238484224:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754715.052928:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1769754715.052940:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1769754715.052945:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1855720238484736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.052967:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1855720238484736:12345-0@lo:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754715.052972:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1769754715.052981:0:55349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1769754715.052985:0:55349:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1855720238485248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.053003:0:55349:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1855720238485248:12345-0@lo:400:kworker.0 Request processed in 18us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754715.053007:0:55349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1769754715.053022:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1769754715.053027:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769754715.053029:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1769754715.053032:0:53850:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769754715.053041:0:53860:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238484352 00000100:00100000:1.0:1769754715.053043:0:53860:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238484352 00000100:00100000:1.0:1769754715.053066:0:53860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1769754715.053077:0:53860:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1855720238484352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.053106:0:53860:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1855720238484352:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754715.053110:0:53860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1769754715.053153:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1855720238484224:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.053161:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1855720238484736:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.053168:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1855720238485248:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.053175:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1855720238484352:0@lo:400:kworker.0 00000100:00100000:1.0:1769754715.053182:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3432dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1855720238484864:0@lo:400:kworker.0 00000100:00100000:2.0:1769754715.053284:0:53848:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238483840 00000100:00100000:2.0:1769754715.053288:0:53848:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238483840 00000100:00100000:2.0:1769754715.053313:0:53848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1769754715.053318:0:53848:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af031f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3659:x1855720238483840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769754715.053348:0:53848:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af031f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a13ee795-4761-483e-b23a-f08e958dcf18+23:3659:x1855720238483840:12345-0@lo:400:kworker.0 Request processed in 29us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754715.053354:0:53848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1769754715.054165:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af28863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a13ee795-4761-483e-b23a-f08e958dcf18:3659:1855720238483840:0@lo:400:kworker.0 00010000:00010000:2.0:1769754715.496292:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769754715.566487:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1769754715.566511:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769754715.566605:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769754715.566770:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485376 00000100:00100000:2.0:1769754715.566778:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485376 00000100:00100000:2.0:1769754715.566841:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1769754715.566851:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238485376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1769754715.566870:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3824304128 avail 3592781824 00000100:00100000:2.0:1769754715.566923:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238485376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754715.566942:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1769754715.567063:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238485376:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1769754716.084973:0:53834:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738483 is committed 00000004:00080000:0.0:1769754716.085007:0:53834:0:(osp_sync.c:1806:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1769754716.085037:0:53834:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ae0296d0c0 refcount 2 committed 0 result 0 batchid 30064771700 00000020:00080000:0.0:1769754716.085044:0:53834:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff94ae10ebc200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ae0296de40 00000020:00080000:0.0:1769754716.085047:0:53834:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff94ae10ebcf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94af0677ee00 00000020:00080000:0.0:1769754716.085084:0:53834:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771699 batchid updated 00000020:00080000:0.0:1769754716.085100:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771700 committed batchid 30064771699 00000100:00100000:3.0:1769754716.085635:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1769754716.085661:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238485504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1769754716.085742:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754716.085789:0:56217:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485504 00000100:00100000:3.0:1769754716.085798:0:56217:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485504 00000100:00100000:3.0:1769754716.085853:0:56217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1769754716.085863:0:56217:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af3118dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1855720238485504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1769754716.085890:0:56217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:228 count 1 00002000:00010000:3.0:1769754716.085928:0:56217:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xe4:0x0] initial LVB size: 11, mtime: 0x697c5059, atime: 0x697c5059, ctime: 0x697c5059, blocks: 0x8 00010000:00010000:3.0:1769754716.085939:0:56217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.085974:0:56217:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754716.085977:0:56217:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769754716.085984:0:56217:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086028:0:56217:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086039:0:56217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086047:0:56217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086064:0:56217:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1769754716.086806:0:56217:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af3118dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3661:x1855720238485504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 940us (1059us total) trans 34359738383 rc 0/0 00000100:00100000:3.0:1769754716.086817:0:56217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1769754716.086851:0:53843:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1769754716.086858:0:53843:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086868:0:53843:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94af295a7600 already unused, calling callback (ffffffffc0ed6360) 00010000:00010000:3.0:1769754716.086873:0:53843:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086884:0:53843:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086903:0:53843:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086933:0:53843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df0b66b4/0x98cc23d8b84979f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 56217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1769754716.086953:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769754716.086955:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769754716.086956:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1769754716.086994:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94af3118d500/2, rc 0, transno 34359738383 00000100:00100000:3.0:1769754716.087000:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3118d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1855720238485504:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1769754716.087201:0:53894:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771699 00010000:00010000:1.0:1769754716.087715:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754716.087734:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754716.087741:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754716.087746:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff94ae0ab8b400 already unused, calling callback (ffffffffc1b1d550) 00010000:00010000:1.0:1769754716.087751:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754716.087758:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754716.087782:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff94af3d404900) 00010000:00010000:1.0:1769754716.087786:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769754716.087790:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1769754716.087797:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ae0ab8b400/0x98cc23d8b8497933 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1769754716.524253:0:53842:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769754716.590253:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2899a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238485632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769754716.590377:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754716.590981:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1769754716.590994:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af2d208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1769754716.591051:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769754716.591101:0:55330:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485760 00000100:00100000:0.0:1769754716.591112:0:55330:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485760 00000100:00100000:0.0:1769754716.591183:0:55330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1769754716.591215:0:55330:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2d20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1855720238485760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1769754716.591263:0:55330:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33943232 pending 28672 free 3776659456 avail 3545137152 00000100:00100000:0.0:1769754716.591313:0:55330:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2d20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1855720238485760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1769754716.591322:0:55330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1769754716.591387:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2d208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1855720238485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1769754716.591670:0:53859:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485632 00000100:00100000:2.0:1769754716.591676:0:53859:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485632 00000100:00100000:2.0:1769754716.591718:0:53859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1769754716.591726:0:53859:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2d20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1855720238485632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1769754716.591758:0:53859:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446068224 avail 1299828736 00000100:00100000:2.0:1769754716.591809:0:53859:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2d20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1855720238485632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1769754716.591831:0:53859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1769754716.592534:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af2899a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1855720238485632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1769754716.614656:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1769754716.614688:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af3fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238485888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1769754716.614800:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769754716.614917:0:55329:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238485888 00000100:00100000:1.0:1769754716.614929:0:55329:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238485888 00000100:00100000:1.0:1769754716.614997:0:55329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1769754716.615007:0:55329:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2899b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238485888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1769754716.615039:0:55329:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 33943232 pending 28672 free 3776659456 avail 3545137152 00000100:00100000:1.0:1769754716.615098:0:55329:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2899b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1855720238485888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1769754716.615107:0:55329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1769754716.615162:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af3fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1855720238485888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1769754717.099095:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238486016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769754717.099224:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769754717.099402:0:53860:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855720238486016 00000100:00100000:3.0:1769754717.099416:0:53860:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855720238486016 00000100:00100000:3.0:1769754717.099504:0:53860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1769754717.099517:0:53860:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff94af2d208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1855720238486016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1769754717.099590:0:53860:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446244352 avail 1300004864 00000100:00100000:3.0:1769754717.099652:0:53860:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff94af2d208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1855720238486016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1769754717.099660:0:53860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1769754717.099720:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94af20abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1855720238486016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1769754717.554265:0:53843:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2581 lines, 2581 kept, 0 dropped, 0 bad.